[ 598.083210] env[69920]: INFO neutron.common.config [-] Logging enabled! [ 598.083664] env[69920]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev45 [ 598.083664] env[69920]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69920) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 598.083960] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 598.084077] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 598.084991] env[69920]: WARNING oslo_policy.policy [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 598.085229] env[69920]: WARNING oslo_policy.policy [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 598.086715] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] VMware NSXv3 Agent initialized successfully. [ 598.087114] env[69920]: DEBUG oslo_concurrency.lockutils [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] Acquiring lock "singleton_lock" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.087262] env[69920]: DEBUG oslo_concurrency.lockutils [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] Acquired lock "singleton_lock" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.087476] env[69920]: DEBUG oslo_concurrency.lockutils [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] Releasing lock "singleton_lock" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.087920] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] Full set of CONF: {{(pid=69920) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 598.088068] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ******************************************************************************** {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 598.088187] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] Configuration options gathered from: {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 598.088448] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 598.088628] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 598.088769] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ================================================================================ {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 598.089011] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] agent_down_time = 75 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.089202] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] allow_automatic_dhcp_failover = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.089356] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] allow_bulk = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.089516] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] api_extensions_path = {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.089711] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] api_paste_config = api-paste.ini {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.089867] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] auth_strategy = keystone {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.089985] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] backdoor_port = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.090110] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] backdoor_socket = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.090268] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] backlog = 4096 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.090483] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] base_mac = fa:16:3e:00:00:00 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.090668] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] bind_host = 0.0.0.0 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.090824] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] bind_port = 9696 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.090972] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] client_socket_timeout = 900 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.091138] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] config_dir = [] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.091256] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.091408] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] config_source = [] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.091596] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] control_exchange = neutron {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.091755] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] core_plugin = ml2 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.091882] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] debug = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.092039] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] default_availability_zones = [] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.092259] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.092433] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] dhcp_agent_notification = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.092613] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] dhcp_agents_per_network = 1 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.092734] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] dhcp_lease_duration = 86400 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.092886] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] dhcp_load_type = networks {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.093045] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] dns_domain = openstacklocal {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.093197] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.093352] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] enable_default_route_bfd = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.093496] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] enable_default_route_ecmp = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.093636] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] enable_dvr = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.093814] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] enable_new_agents = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.093972] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.094128] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] enable_signals = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.094269] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] enable_traditional_dhcp = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.094406] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] external_dns_driver = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.094545] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] filter_validation = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.094732] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] global_physnet_mtu = 8950 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.094879] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] graceful_shutdown_timeout = 60 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.095080] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] host = cpu-1 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.095234] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] host_dvr_for_dhcp = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.095380] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] http_retries = 3 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.095533] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] instance_format = [instance: %(uuid)s] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.095681] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.095826] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ipam_driver = internal {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.095965] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ipv6_pd_enabled = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.096123] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] l3_ha = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.096269] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.096414] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] l3_ha_network_physical_name = {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.096565] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] l3_ha_network_type = {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.096710] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] log_color = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.096904] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] log_config_append = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.097066] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.097367] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] log_dir = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.097367] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] log_file = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.097462] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] log_options = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.097604] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] log_rotate_interval = 1 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.097756] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] log_rotate_interval_type = days {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.097902] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] log_rotation_type = none {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.098032] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.098148] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.098299] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.098447] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.098564] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.098700] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] max_dns_nameservers = 5 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.098842] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] max_header_line = 16384 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.098982] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] max_l3_agents_per_router = 3 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.099136] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] max_logfile_count = 30 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.099275] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] max_logfile_size_mb = 200 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.099415] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] max_subnet_host_routes = 20 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.099567] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] my_ip = 10.180.1.21 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.099712] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] my_ipv6 = ::1 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.099856] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] network_auto_schedule = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.099995] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] network_link_prefix = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.100157] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.100304] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] notify_nova_on_port_data_changes = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.100452] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] notify_nova_on_port_status_changes = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.100600] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] pagination_max_limit = -1 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.100746] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] publish_errors = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.100889] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] rate_limit_burst = 0 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.101049] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] rate_limit_except_level = CRITICAL {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.101194] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] rate_limit_interval = 0 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.101336] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] retry_until_window = 30 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.101480] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] router_distributed = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.101624] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] rpc_resources_processing_step = 20 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.101764] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] rpc_response_max_timeout = 600 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.101910] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] rpc_response_timeout = 60 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.102060] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] send_events_interval = 2 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.102222] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] service_plugins = ['router'] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.102384] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] setproctitle = on {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.102536] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] shell_completion = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.102742] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] state_path = /opt/stack/data/neutron {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.102830] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] syslog_log_facility = LOG_USER {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.103030] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] tcp_keepidle = 600 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.103139] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] transport_url = **** {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.103262] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] use_journal = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.103436] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] use_json = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.103596] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] use_ssl = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.104038] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] use_stderr = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.104038] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] use_syslog = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.104038] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] vlan_qinq = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.104232] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] vlan_transparent = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.104294] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] watch_log_file = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.104443] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] wsgi_default_pool_size = 100 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.104585] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] wsgi_keep_alive = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.104763] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.104920] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] wsgi_server_debug = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 598.105090] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_concurrency.disable_process_locking = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.105248] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.105403] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.105551] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.105704] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.105852] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.105998] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.106314] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] profiler.connection_string = messaging:// {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.106314] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] profiler.enabled = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.106895] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] profiler.es_doc_type = notification {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.106895] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] profiler.es_scroll_size = 10000 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.106895] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] profiler.es_scroll_time = 2m {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.106982] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] profiler.filter_error_trace = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.107178] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] profiler.hmac_keys = **** {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.107240] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] profiler.sentinel_service_name = mymaster {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.107383] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] profiler.socket_timeout = 0.1 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.107527] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] profiler.trace_requests = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.107670] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] profiler.trace_sqlalchemy = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.107827] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] profiler_jaeger.process_tags = {} {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.107967] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] profiler_jaeger.service_name_prefix = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.108119] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] profiler_otlp.service_name_prefix = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.108281] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_policy.enforce_new_defaults = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.108633] env[69920]: WARNING oslo_config.cfg [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 598.108746] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_policy.enforce_scope = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.108867] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_policy.policy_default_rule = default {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.109043] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.109202] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.109355] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.109523] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.109677] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.109823] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.109970] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.110134] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_policy.remote_timeout = 60.0 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.110296] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.110454] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] agent.extensions = [] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.110608] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.110760] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] service_providers.service_provider = [] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.110914] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] QUOTAS.default_quota = -1 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.111076] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.111431] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] QUOTAS.quota_floatingip = 50 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.111431] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] QUOTAS.quota_network = 100 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.111557] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] QUOTAS.quota_port = 500 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.111641] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.111784] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] QUOTAS.quota_router = 10 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.111926] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] QUOTAS.quota_security_group = 10 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.112097] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.112228] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] QUOTAS.quota_subnet = 100 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.112486] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] QUOTAS.track_quota_usage = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.112573] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.112713] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep.group = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.112853] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep.helper_command = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.113035] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.113164] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep.thread_pool_size = 8 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.113305] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep.user = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.113461] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.113683] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_dhcp_release.group = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.113751] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_dhcp_release.helper_command = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.113886] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.114041] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.114181] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_dhcp_release.user = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.114328] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.114467] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_ovs_vsctl.group = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.114606] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_ovs_vsctl.helper_command = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.114782] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.114930] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.115080] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_ovs_vsctl.user = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.115318] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_namespace.capabilities = [21] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.115383] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_namespace.group = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.115504] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_namespace.helper_command = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.115675] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.115826] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_namespace.thread_pool_size = 8 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.115965] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_namespace.user = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.116127] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_conntrack.capabilities = [12] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.116267] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_conntrack.group = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.116406] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_conntrack.helper_command = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.116555] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.116701] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.116838] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_conntrack.user = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.116986] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_link.capabilities = [12, 21] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.117138] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_link.group = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.117317] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_link.helper_command = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.117646] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.117646] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_link.thread_pool_size = 8 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.117782] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] privsep_link.user = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.117835] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.117978] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.118139] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT.continue_on_failed_promotions = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.118287] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT.dscp = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.118532] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT.dscp_inherit = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.118616] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT.force_mp_to_policy = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.118730] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT.locking_coordinator_url = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.118875] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT.log_agent_heartbeats = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.119029] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT.logging_expire = 1 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.119182] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.119328] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.119482] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT.polling_interval = 240 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.119629] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.119799] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.119927] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT.report_interval = 30.0 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.120088] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.120455] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.120455] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.120540] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT.sync_skew = 60 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.120675] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT.synchronization_queue_size = 20 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.120862] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT.use_helper_for_ns_read = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.120967] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] SECURITYGROUP.enable_ipset = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.121129] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] SECURITYGROUP.enable_security_group = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.121281] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.121444] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.121600] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] experimental.ipv6_pd_enabled = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.122164] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ml2.extension_drivers = ['port_security'] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.122164] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ml2.external_network_type = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.122164] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.122291] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ml2.overlay_ip_version = 4 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.122396] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ml2.path_mtu = 8950 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.122560] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ml2.physical_network_mtus = {} {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.122717] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ml2.tenant_network_types = ['vlan'] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.122868] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.123031] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ml2.type_drivers = ['vlan'] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.123187] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT_CLI.neutron_port_id = [] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.123331] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.123479] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.123638] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.123793] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.123946] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.124106] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.124258] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.124404] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.124630] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.124824] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] NSXV3.nsxv3_login_password = **** {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.124991] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] NSXV3.nsxv3_login_port = 443 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.125160] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] NSXV3.nsxv3_login_user = admin {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.125313] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.125465] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.125726] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.125796] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.125901] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.126077] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.126235] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.126386] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.126583] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.126684] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.126843] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.126991] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.127156] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.127369] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.127614] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] vsphere.vsphere_login_password = VMware1! {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.127676] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.127841] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.128090] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] nova.auth_section = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.128174] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] nova.auth_type = password {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.128319] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.128466] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] nova.certfile = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.128613] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] nova.collect_timing = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.128768] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] nova.endpoint_type = public {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.128926] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] nova.insecure = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.129059] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] nova.keyfile = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.129354] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] nova.region_name = RegionOne {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.129354] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] nova.split_loggers = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.129492] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] nova.timeout = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.129634] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] placement.auth_section = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.129813] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] placement.auth_type = password {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.129938] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.130091] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] placement.certfile = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.130235] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] placement.collect_timing = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.130403] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] placement.endpoint_type = public {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.130558] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] placement.insecure = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.130733] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] placement.keyfile = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.130834] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] placement.region_name = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.130975] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] placement.split_loggers = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.131126] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] placement.timeout = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.131274] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.auth_section = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.131417] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.auth_type = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.131583] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.cafile = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.131691] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.certfile = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.131982] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.collect_timing = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.131982] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.connect_retries = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.132117] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.connect_retry_delay = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.132261] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.enable_notifications = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.132447] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.endpoint_override = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.132595] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.insecure = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.132740] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.interface = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.132878] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.keyfile = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.133085] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.max_version = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.133208] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.min_version = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.133425] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.region_name = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.133481] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.retriable_status_codes = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.133603] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.service_name = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.133746] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.service_type = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.133889] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.split_loggers = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.134038] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.status_code_retries = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.134191] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.status_code_retry_delay = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.134314] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.timeout = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.134486] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.valid_interfaces = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.134594] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ironic.version = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.134766] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] cli_script.dry_run = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.134933] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.135092] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.135241] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.135384] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.135552] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.135712] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.135846] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.135991] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.136153] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.136305] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.136467] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.136634] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.136786] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.136934] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.137096] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.137251] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.137397] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.137544] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.137716] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.137836] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.137978] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.138141] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.138291] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.138669] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.138669] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.138786] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.138941] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.139104] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.139295] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.139416] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.139537] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.ssl = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.139699] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.139832] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.140033] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.140364] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.140364] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.ssl_version = {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.140474] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.140561] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_notifications.driver = [] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.140783] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_notifications.retry = -1 {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.140864] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.141023] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] oslo_messaging_notifications.transport_url = **** {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 598.141138] env[69920]: DEBUG oslo_service.backend.eventlet.service [None req-9758c8e5-428b-4c78-9cdf-8f75789bb422 None None] ******************************************************************************** {{(pid=69920) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 598.142484] env[69920]: DEBUG neutron.agent.securitygroups_rpc [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Init firewall settings (driver=nsxv3) {{(pid=69920) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 598.143647] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69920) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 598.143951] env[69920]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] RPC agent_id: nsxm-l-01a.corp.local [ 598.146455] env[69920]: DEBUG dogpile.cache.region [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 598.146573] env[69920]: DEBUG dogpile.lock [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 598.146699] env[69920]: DEBUG dogpile.lock [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 598.146807] env[69920]: DEBUG dogpile.lock [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 598.146908] env[69920]: DEBUG dogpile.cache.region [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 598.147010] env[69920]: DEBUG dogpile.lock [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 598.147144] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 598.166664] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Session token - acquiring [ 598.168251] env[69920]: DEBUG networking_nsxv3.common.locking [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.168506] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.168647] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.169099] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.180013] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.476629] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 598.498027] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 598.498190] env[69920]: DEBUG dogpile.cache.region [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Cache value generated in 0.351 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 598.498310] env[69920]: DEBUG dogpile.lock [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 598.498433] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Activating Policy API Provider. [ 598.498633] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Looking for the default Infrastructure Rules. [ 598.568073] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Looking for the Default Layer3 Logged Drop Section. [ 598.584364] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 598.584882] env[69920]: DEBUG networking_nsxv3.common.locking [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.585091] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquiring lock "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.585207] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquired lock "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.585488] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquired external semaphore "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.585826] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.102587] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.605278] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.107993] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Inventory metadata is going to be refreshed. [ 600.108388] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 600.976917] env[69920]: DEBUG networking_nsxv3.common.locking [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.977191] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.977264] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.977613] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.988459] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 600.989439] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.990418] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 601.008839] env[69920]: DEBUG networking_nsxv3.common.locking [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.009235] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.009398] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.009746] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.009924] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.010131] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 601.010298] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 601.010472] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 601.030132] env[69920]: DEBUG networking_nsxv3.common.locking [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.030413] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.030524] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.030854] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.031093] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.031285] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 601.054907] env[69920]: DEBUG networking_nsxv3.common.locking [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.055261] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.055430] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.055785] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.055982] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.056186] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 601.077419] env[69920]: DEBUG networking_nsxv3.common.locking [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.078158] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquiring lock "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.078360] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquired lock "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.078687] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquired external semaphore "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.078885] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Releasing lock "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.079093] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 601.079241] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 601.079387] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 601.097919] env[69920]: DEBUG networking_nsxv3.common.locking [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.098290] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquiring lock "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.098290] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquired lock "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.098663] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquired external semaphore "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.098839] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Releasing lock "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.099029] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 601.099176] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 601.099324] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 601.118188] env[69920]: DEBUG networking_nsxv3.common.locking [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.118616] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.118616] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.118920] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.119092] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.119295] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 601.119443] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 601.119582] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Inventory metadata have been refreshed. [ 601.119715] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Dryrun:True. Metadata refresh completed. [ 601.119872] env[69920]: DEBUG oslo_concurrency.lockutils [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Releasing lock "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.121620] env[69920]: INFO neutron.agent.agent_extensions_manager [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Loaded agent extensions: [] [ 601.122558] env[69920]: DEBUG neutron_lib.callbacks.manager [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69920) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 601.174815] env[69920]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] NSXv3 Agent Agent RPC Daemon Started! [ 601.174970] env[69920]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] NSXv3 Agent Agent loop - iteration:0 started [ 601.175072] env[69920]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] NSXv3 Agent Agent out of sync with plugin! [ 606.122828] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 606.123245] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 607.127231] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.127231] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.127231] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.127231] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.127231] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.628765] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.131241] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.633825] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 608.634079] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 609.374516] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.375059] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.375059] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.375059] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.386517] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 609.388743] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.389411] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 609.408666] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.408989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.408989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.409677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.409677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.409677] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 609.409677] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 609.409677] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 609.428351] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.428635] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.428635] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.428799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.428936] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.429068] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 609.448859] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.449152] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.449152] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.449305] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.449436] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.449549] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 609.469338] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.469677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.469677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.469811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.469858] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.469995] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 609.470080] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 609.470155] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 609.488070] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.488343] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.488343] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.488523] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.488614] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.488798] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 609.488798] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 609.489034] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 609.510637] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.510927] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.510927] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.511265] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.511265] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.511369] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 609.511369] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 609.511461] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 609.511513] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 609.511591] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 609.511654] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 609.511719] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 609.512010] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 609.512088] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 609.512227] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 609.531223] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.531476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.531476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.531590] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.531702] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.531815] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 609.551160] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.551469] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.551469] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.551590] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.551682] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.565440] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.123860] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 611.124215] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 615.921429] env[69920]: INFO networking_nsxv3.common.synchronization [None req-7ecd916c-dbba-4fba-82ac-a847b37aeff4 demo admin] Enqueued Resource ID: 52e2c2a3-3ff0-46c5-9e40-c3cd3f129a4b with Priority: HIGHEST for action security_group_rules [ 615.922049] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52e2c2a3-3ff0-46c5-9e40-c3cd3f129a4b with Priority: HIGHEST for action security_group_rules [ 615.922368] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52e2c2a3-3ff0-46c5-9e40-c3cd3f129a4b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.922492] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52e2c2a3-3ff0-46c5-9e40-c3cd3f129a4b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.922585] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52e2c2a3-3ff0-46c5-9e40-c3cd3f129a4b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.922832] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52e2c2a3-3ff0-46c5-9e40-c3cd3f129a4b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.922919] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52e2c2a3-3ff0-46c5-9e40-c3cd3f129a4b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.444252] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.444475] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.444475] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.444658] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.444750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.444903] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52e2c2a3-3ff0-46c5-9e40-c3cd3f129a4b already deleted. [ 616.444967] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52e2c2a3-3ff0-46c5-9e40-c3cd3f129a4b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.923199] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 620.923618] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 625.925173] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 625.926069] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 630.927312] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 630.927676] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 635.928805] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 635.929219] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 640.930471] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 640.930825] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 645.931402] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 645.931922] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 648.271830] env[69920]: INFO networking_nsxv3.common.synchronization [None req-c246dbe1-b391-485a-ac7f-16a251fd6996 None None] Enqueued Resource ID: dfbcd7a8-3752-4b17-9b2a-f958422dd6bf with Priority: HIGHEST for action port [ 648.272733] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbcd7a8-3752-4b17-9b2a-f958422dd6bf with Priority: HIGHEST for action port [ 648.273123] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfbcd7a8-3752-4b17-9b2a-f958422dd6bf taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.273954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfbcd7a8-3752-4b17-9b2a-f958422dd6bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.273954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfbcd7a8-3752-4b17-9b2a-f958422dd6bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.273954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfbcd7a8-3752-4b17-9b2a-f958422dd6bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.273954] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfbcd7a8-3752-4b17-9b2a-f958422dd6bf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.371254] env[69920]: INFO networking_nsxv3.common.synchronization [None req-0dfc28c9-afd9-4c99-ad53-17303c92e2bb None None] Enqueued Resource ID: de50c6e5-ce50-4bba-8d2e-28bdbeca43f7 with Priority: HIGHEST for action port [ 648.371254] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de50c6e5-ce50-4bba-8d2e-28bdbeca43f7 with Priority: HIGHEST for action port [ 648.371254] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-de50c6e5-ce50-4bba-8d2e-28bdbeca43f7 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.373269] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de50c6e5-ce50-4bba-8d2e-28bdbeca43f7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.373455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de50c6e5-ce50-4bba-8d2e-28bdbeca43f7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.373789] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de50c6e5-ce50-4bba-8d2e-28bdbeca43f7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.374067] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de50c6e5-ce50-4bba-8d2e-28bdbeca43f7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.777052] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dfbcd7a8-3752-4b17-9b2a-f958422dd6bf [ 648.777052] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.777052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.777052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.777052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.777052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.777052] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dfbcd7a8-3752-4b17-9b2a-f958422dd6bf already deleted. [ 648.777052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfbcd7a8-3752-4b17-9b2a-f958422dd6bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.881397] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de50c6e5-ce50-4bba-8d2e-28bdbeca43f7 [ 648.881611] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.881743] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.881810] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.882045] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.882132] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.882226] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de50c6e5-ce50-4bba-8d2e-28bdbeca43f7 already deleted. [ 648.882306] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de50c6e5-ce50-4bba-8d2e-28bdbeca43f7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.996519] env[69920]: INFO networking_nsxv3.common.synchronization [None req-c7a85f86-e106-4a97-8897-16292e1f5de2 None None] Enqueued Resource ID: 7818c8ed-6f30-4776-bdc9-0b81d45fd921 with Priority: HIGHEST for action port [ 648.996828] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7818c8ed-6f30-4776-bdc9-0b81d45fd921 with Priority: HIGHEST for action port [ 648.997268] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-7818c8ed-6f30-4776-bdc9-0b81d45fd921 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.997382] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7818c8ed-6f30-4776-bdc9-0b81d45fd921" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.997486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7818c8ed-6f30-4776-bdc9-0b81d45fd921" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.997690] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7818c8ed-6f30-4776-bdc9-0b81d45fd921" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.997807] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7818c8ed-6f30-4776-bdc9-0b81d45fd921',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.500277] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7818c8ed-6f30-4776-bdc9-0b81d45fd921 [ 649.500542] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.500623] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.500688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.500902] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.500987] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.501088] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7818c8ed-6f30-4776-bdc9-0b81d45fd921 already deleted. [ 649.501164] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7818c8ed-6f30-4776-bdc9-0b81d45fd921" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.645179] env[69920]: INFO networking_nsxv3.common.synchronization [None req-194ac54e-1ce0-4f0a-aa20-45f583fc7d14 None None] Enqueued Resource ID: 3dbf2e32-c171-4a5f-93cf-d5d803871543 with Priority: HIGHEST for action port [ 649.645179] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dbf2e32-c171-4a5f-93cf-d5d803871543 with Priority: HIGHEST for action port [ 649.645736] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-3dbf2e32-c171-4a5f-93cf-d5d803871543 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.645846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3dbf2e32-c171-4a5f-93cf-d5d803871543" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.645924] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3dbf2e32-c171-4a5f-93cf-d5d803871543" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.646315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3dbf2e32-c171-4a5f-93cf-d5d803871543" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.646397] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dbf2e32-c171-4a5f-93cf-d5d803871543',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.834021] env[69920]: INFO networking_nsxv3.common.synchronization [None req-396c4ea6-de96-459c-af16-693accd30280 None None] Enqueued Resource ID: d35c3ba4-5a42-41a9-aa64-01abbc50c0e7 with Priority: HIGHEST for action port [ 649.834382] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d35c3ba4-5a42-41a9-aa64-01abbc50c0e7 with Priority: HIGHEST for action port [ 649.835242] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-d35c3ba4-5a42-41a9-aa64-01abbc50c0e7 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.835376] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d35c3ba4-5a42-41a9-aa64-01abbc50c0e7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.835439] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d35c3ba4-5a42-41a9-aa64-01abbc50c0e7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.836215] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d35c3ba4-5a42-41a9-aa64-01abbc50c0e7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.836315] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d35c3ba4-5a42-41a9-aa64-01abbc50c0e7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.150910] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3dbf2e32-c171-4a5f-93cf-d5d803871543 [ 650.151151] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.151296] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.151368] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.151569] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.151686] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.151759] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3dbf2e32-c171-4a5f-93cf-d5d803871543 already deleted. [ 650.151850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3dbf2e32-c171-4a5f-93cf-d5d803871543" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.338745] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d35c3ba4-5a42-41a9-aa64-01abbc50c0e7 [ 650.338981] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.339155] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.339197] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.339405] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.339490] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.339584] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d35c3ba4-5a42-41a9-aa64-01abbc50c0e7 already deleted. [ 650.339667] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d35c3ba4-5a42-41a9-aa64-01abbc50c0e7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.035830] env[69920]: INFO networking_nsxv3.common.synchronization [None req-c7651be8-93bb-4579-808f-5d62dc795bf4 None None] Enqueued Resource ID: eb826b5a-457d-440d-a6eb-08feb0dfdfe3 with Priority: HIGHEST for action port [ 651.038078] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb826b5a-457d-440d-a6eb-08feb0dfdfe3 with Priority: HIGHEST for action port [ 651.038078] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb826b5a-457d-440d-a6eb-08feb0dfdfe3 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.038078] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb826b5a-457d-440d-a6eb-08feb0dfdfe3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.038078] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb826b5a-457d-440d-a6eb-08feb0dfdfe3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.038078] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb826b5a-457d-440d-a6eb-08feb0dfdfe3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.038078] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb826b5a-457d-440d-a6eb-08feb0dfdfe3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.127727] env[69920]: INFO networking_nsxv3.common.synchronization [None req-7681792e-bbcb-449d-8c95-1079858c0da6 None None] Enqueued Resource ID: 0c2b117a-39ac-41b0-8661-cde1fd4a86de with Priority: HIGHEST for action port [ 651.127988] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c2b117a-39ac-41b0-8661-cde1fd4a86de with Priority: HIGHEST for action port [ 651.128644] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c2b117a-39ac-41b0-8661-cde1fd4a86de taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.128766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c2b117a-39ac-41b0-8661-cde1fd4a86de" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.128830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c2b117a-39ac-41b0-8661-cde1fd4a86de" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.129964] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c2b117a-39ac-41b0-8661-cde1fd4a86de" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.130076] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c2b117a-39ac-41b0-8661-cde1fd4a86de',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.542092] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb826b5a-457d-440d-a6eb-08feb0dfdfe3 [ 651.542321] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.542686] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.543067] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.543067] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.543170] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.543282] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb826b5a-457d-440d-a6eb-08feb0dfdfe3 already deleted. [ 651.543343] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb826b5a-457d-440d-a6eb-08feb0dfdfe3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.635891] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c2b117a-39ac-41b0-8661-cde1fd4a86de [ 651.636140] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.636280] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.636351] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.636566] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.636661] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.636758] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c2b117a-39ac-41b0-8661-cde1fd4a86de already deleted. [ 651.636843] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c2b117a-39ac-41b0-8661-cde1fd4a86de" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.153060] env[69920]: INFO networking_nsxv3.common.synchronization [None req-6a91b204-8d21-4a02-aa5e-1e09a8735f1c None None] Enqueued Resource ID: e73ab864-93ce-4004-a9f8-44d615d621d9 with Priority: HIGHEST for action port [ 652.154418] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e73ab864-93ce-4004-a9f8-44d615d621d9 with Priority: HIGHEST for action port [ 652.154418] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-e73ab864-93ce-4004-a9f8-44d615d621d9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.154418] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e73ab864-93ce-4004-a9f8-44d615d621d9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.154418] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e73ab864-93ce-4004-a9f8-44d615d621d9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.154418] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e73ab864-93ce-4004-a9f8-44d615d621d9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.154689] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e73ab864-93ce-4004-a9f8-44d615d621d9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.614390] env[69920]: INFO networking_nsxv3.common.synchronization [None req-f5638431-e110-48e5-b4b0-4e33feed1277 None None] Enqueued Resource ID: 9d61609d-4382-478d-9dcf-02153f69d100 with Priority: HIGHEST for action port [ 652.614390] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d61609d-4382-478d-9dcf-02153f69d100 with Priority: HIGHEST for action port [ 652.614390] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d61609d-4382-478d-9dcf-02153f69d100 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.614390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d61609d-4382-478d-9dcf-02153f69d100" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.614390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d61609d-4382-478d-9dcf-02153f69d100" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.615791] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d61609d-4382-478d-9dcf-02153f69d100" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.616047] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d61609d-4382-478d-9dcf-02153f69d100',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.661609] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e73ab864-93ce-4004-a9f8-44d615d621d9 [ 652.661609] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.661609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.661609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.661609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.661609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.661609] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e73ab864-93ce-4004-a9f8-44d615d621d9 already deleted. [ 652.661609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e73ab864-93ce-4004-a9f8-44d615d621d9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.121250] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d61609d-4382-478d-9dcf-02153f69d100 [ 653.121250] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.121250] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.121250] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.121250] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.121250] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.121250] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d61609d-4382-478d-9dcf-02153f69d100 already deleted. [ 653.121250] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d61609d-4382-478d-9dcf-02153f69d100" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.602051] env[69920]: INFO networking_nsxv3.common.synchronization [None req-09e0e1db-7483-4cdf-863a-e279488ab53d None None] Enqueued Resource ID: 3adcf57f-8432-4aa1-a7f3-079ea01a8bde with Priority: HIGHEST for action port [ 653.602365] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3adcf57f-8432-4aa1-a7f3-079ea01a8bde with Priority: HIGHEST for action port [ 653.602855] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-3adcf57f-8432-4aa1-a7f3-079ea01a8bde taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.603225] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3adcf57f-8432-4aa1-a7f3-079ea01a8bde" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.603225] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3adcf57f-8432-4aa1-a7f3-079ea01a8bde" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.603657] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3adcf57f-8432-4aa1-a7f3-079ea01a8bde" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.603657] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3adcf57f-8432-4aa1-a7f3-079ea01a8bde',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.014788] env[69920]: INFO networking_nsxv3.common.synchronization [None req-a1811db7-bc9a-4efc-b298-f7210b6c57d1 None None] Enqueued Resource ID: 66a46a13-b4ed-4da6-baa8-8ab3a4a1dc34 with Priority: HIGHEST for action port [ 654.015660] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66a46a13-b4ed-4da6-baa8-8ab3a4a1dc34 with Priority: HIGHEST for action port [ 654.015660] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-66a46a13-b4ed-4da6-baa8-8ab3a4a1dc34 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.015799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66a46a13-b4ed-4da6-baa8-8ab3a4a1dc34" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.015799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66a46a13-b4ed-4da6-baa8-8ab3a4a1dc34" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.016202] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66a46a13-b4ed-4da6-baa8-8ab3a4a1dc34" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.016202] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66a46a13-b4ed-4da6-baa8-8ab3a4a1dc34',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.040296] env[69920]: INFO networking_nsxv3.common.synchronization [None req-9ac877d0-17a9-4355-8c6e-72d7099acc57 tempest-ServersTestJSON-2147431032 tempest-ServersTestJSON-2147431032-project-member] Enqueued Resource ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 with Priority: HIGHEST for action security_group_rules [ 654.040296] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 with Priority: HIGHEST for action security_group_rules [ 654.043965] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e86ba42-7c29-4732-915b-33713b63d0b7 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.044132] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.044318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.044462] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.044552] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e86ba42-7c29-4732-915b-33713b63d0b7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.107700] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3adcf57f-8432-4aa1-a7f3-079ea01a8bde [ 654.107926] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.108071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.108140] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.108352] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.108436] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.108525] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3adcf57f-8432-4aa1-a7f3-079ea01a8bde already deleted. [ 654.108604] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3adcf57f-8432-4aa1-a7f3-079ea01a8bde" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.251973] env[69920]: INFO networking_nsxv3.common.synchronization [None req-f5aae1e7-509d-4a57-9324-6d655ab297e5 None None] Enqueued Resource ID: e7326029-0d55-4b10-8da7-ba3d5e63260f with Priority: HIGHEST for action port [ 654.252152] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7326029-0d55-4b10-8da7-ba3d5e63260f with Priority: HIGHEST for action port [ 654.252678] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7326029-0d55-4b10-8da7-ba3d5e63260f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.252801] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7326029-0d55-4b10-8da7-ba3d5e63260f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.252898] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7326029-0d55-4b10-8da7-ba3d5e63260f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.253259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7326029-0d55-4b10-8da7-ba3d5e63260f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.253410] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7326029-0d55-4b10-8da7-ba3d5e63260f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.402860] env[69920]: INFO networking_nsxv3.common.synchronization [None req-504653f7-faad-4aa9-9a95-db1fc8c85f8e tempest-ServersTestJSON-2147431032 tempest-ServersTestJSON-2147431032-project-member] Enqueued Resource ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 with Priority: HIGHEST for action security_group_rules [ 654.403541] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 with Priority: HIGHEST for action security_group_rules [ 654.403971] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e86ba42-7c29-4732-915b-33713b63d0b7 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.404047] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.521925] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66a46a13-b4ed-4da6-baa8-8ab3a4a1dc34 [ 654.521925] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.521925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.521925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.522149] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.522149] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.523401] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66a46a13-b4ed-4da6-baa8-8ab3a4a1dc34 already deleted. [ 654.523401] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66a46a13-b4ed-4da6-baa8-8ab3a4a1dc34" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.569908] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.570069] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.570139] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.570357] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.570441] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.570537] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 already deleted. [ 654.570613] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.570758] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.570910] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.570988] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e86ba42-7c29-4732-915b-33713b63d0b7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.685750] env[69920]: INFO networking_nsxv3.common.synchronization [None req-584fd502-d52c-4bd8-b358-29b53dd7680a tempest-ServersTestBootFromVolume-1196685189 tempest-ServersTestBootFromVolume-1196685189-project-member] Enqueued Resource ID: 361f5d4b-d775-40f2-9486-50f4511d4852 with Priority: HIGHEST for action security_group_rules [ 654.685750] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 361f5d4b-d775-40f2-9486-50f4511d4852 with Priority: HIGHEST for action security_group_rules [ 654.685750] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-361f5d4b-d775-40f2-9486-50f4511d4852 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.685750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.685750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.685750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.685750] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('361f5d4b-d775-40f2-9486-50f4511d4852',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.756034] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7326029-0d55-4b10-8da7-ba3d5e63260f [ 654.756324] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.757095] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.757266] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.757397] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.757487] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.757587] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7326029-0d55-4b10-8da7-ba3d5e63260f already deleted. [ 654.757670] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7326029-0d55-4b10-8da7-ba3d5e63260f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.901700] env[69920]: INFO networking_nsxv3.common.synchronization [None req-370b4abb-26ae-404f-bfa5-5dd6c9ee8944 tempest-ServersTestBootFromVolume-1196685189 tempest-ServersTestBootFromVolume-1196685189-project-member] Enqueued Resource ID: 361f5d4b-d775-40f2-9486-50f4511d4852 with Priority: HIGHEST for action security_group_rules [ 654.902267] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 361f5d4b-d775-40f2-9486-50f4511d4852 with Priority: HIGHEST for action security_group_rules [ 654.903121] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-361f5d4b-d775-40f2-9486-50f4511d4852 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.903121] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.917021] env[69920]: INFO networking_nsxv3.common.synchronization [None req-e1e0b979-6b7d-4b5d-b7d0-9a486e139e44 None None] Enqueued Resource ID: e88722eb-92a8-4a7d-a365-e5659c33f9ca with Priority: HIGHEST for action port [ 654.917021] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e88722eb-92a8-4a7d-a365-e5659c33f9ca with Priority: HIGHEST for action port [ 654.917021] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-e88722eb-92a8-4a7d-a365-e5659c33f9ca taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.917021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e88722eb-92a8-4a7d-a365-e5659c33f9ca" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.917021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e88722eb-92a8-4a7d-a365-e5659c33f9ca" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.917021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e88722eb-92a8-4a7d-a365-e5659c33f9ca" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.917021] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e88722eb-92a8-4a7d-a365-e5659c33f9ca',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.094094] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.094207] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.094292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.094539] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.094658] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.094774] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 already deleted. [ 655.094881] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.215183] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.215329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.215399] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.215613] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.215701] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.215791] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 361f5d4b-d775-40f2-9486-50f4511d4852 already deleted. [ 655.215869] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.216039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.216202] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.216277] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('361f5d4b-d775-40f2-9486-50f4511d4852',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.423298] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e88722eb-92a8-4a7d-a365-e5659c33f9ca [ 655.423465] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.423562] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.423633] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.424129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.424129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.424129] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e88722eb-92a8-4a7d-a365-e5659c33f9ca already deleted. [ 655.424861] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e88722eb-92a8-4a7d-a365-e5659c33f9ca" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.454574] env[69920]: INFO networking_nsxv3.common.synchronization [None req-a6cf0991-13f4-47fe-be38-40500b9f2c7b None None] Enqueued Resource ID: aacdbac5-d1ce-4016-93c5-885c8d02da7b with Priority: HIGHEST for action port [ 655.454574] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aacdbac5-d1ce-4016-93c5-885c8d02da7b with Priority: HIGHEST for action port [ 655.455114] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-aacdbac5-d1ce-4016-93c5-885c8d02da7b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.455243] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aacdbac5-d1ce-4016-93c5-885c8d02da7b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.455323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aacdbac5-d1ce-4016-93c5-885c8d02da7b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.456309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aacdbac5-d1ce-4016-93c5-885c8d02da7b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.456550] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aacdbac5-d1ce-4016-93c5-885c8d02da7b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.605332] env[69920]: INFO networking_nsxv3.common.synchronization [None req-f8c1ff35-d8aa-42b1-b6f4-d5367cd24ab5 None None] Enqueued Resource ID: cdfbb511-d512-40ef-a85c-8e31b0c96235 with Priority: HIGHEST for action port [ 655.605644] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdfbb511-d512-40ef-a85c-8e31b0c96235 with Priority: HIGHEST for action port [ 655.607765] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdfbb511-d512-40ef-a85c-8e31b0c96235 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.607932] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdfbb511-d512-40ef-a85c-8e31b0c96235" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.608013] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdfbb511-d512-40ef-a85c-8e31b0c96235" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.608282] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdfbb511-d512-40ef-a85c-8e31b0c96235" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.608367] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdfbb511-d512-40ef-a85c-8e31b0c96235',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.744626] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.744626] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.744626] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.744626] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.744626] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.744626] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 361f5d4b-d775-40f2-9486-50f4511d4852 already deleted. [ 655.744626] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.961138] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aacdbac5-d1ce-4016-93c5-885c8d02da7b [ 655.961378] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.961945] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.961945] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.962363] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.963064] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.963064] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aacdbac5-d1ce-4016-93c5-885c8d02da7b already deleted. [ 655.963064] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aacdbac5-d1ce-4016-93c5-885c8d02da7b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.110315] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cdfbb511-d512-40ef-a85c-8e31b0c96235 [ 656.110550] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.110694] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.110763] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.110988] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.111095] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.111188] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cdfbb511-d512-40ef-a85c-8e31b0c96235 already deleted. [ 656.111268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdfbb511-d512-40ef-a85c-8e31b0c96235" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.976436] env[69920]: INFO networking_nsxv3.common.synchronization [req-ebe4c8c3-6baf-436c-a0c8-589f63e523ee req-c3d50289-e891-4579-b5e9-87c99d35d833 tempest-ServerDiagnosticsNegativeTest-1566978478 tempest-ServerDiagnosticsNegativeTest-1566978478-project-member] Enqueued Resource ID: 667ad5b8-40a7-4438-a71d-51999e9b972e with Priority: HIGHEST for action security_group_members [ 658.976919] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 667ad5b8-40a7-4438-a71d-51999e9b972e with Priority: HIGHEST for action security_group_members [ 658.976987] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-667ad5b8-40a7-4438-a71d-51999e9b972e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.979434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.979434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.979608] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.979791] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.979901] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.979967] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.980179] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.980272] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.980371] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('667ad5b8-40a7-4438-a71d-51999e9b972e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.487323] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.487323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.487323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.487323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.487323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.487323] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.487323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.487323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.487323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.487323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.487323] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 667ad5b8-40a7-4438-a71d-51999e9b972e already deleted. [ 659.487323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.541161] env[69920]: INFO networking_nsxv3.common.synchronization [None req-0d3003b5-f748-45c7-b98d-f461bcd2488d None None] Enqueued Resource ID: 47cf1f6a-a532-4318-96e2-9315800a0037 with Priority: HIGHEST for action port [ 659.541161] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47cf1f6a-a532-4318-96e2-9315800a0037 with Priority: HIGHEST for action port [ 659.541355] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-47cf1f6a-a532-4318-96e2-9315800a0037 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.541474] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47cf1f6a-a532-4318-96e2-9315800a0037" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.541560] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47cf1f6a-a532-4318-96e2-9315800a0037" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.541846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47cf1f6a-a532-4318-96e2-9315800a0037" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.541930] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47cf1f6a-a532-4318-96e2-9315800a0037',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.044440] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47cf1f6a-a532-4318-96e2-9315800a0037 [ 660.045283] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.045752] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.046356] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.046896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.047782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.047782] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47cf1f6a-a532-4318-96e2-9315800a0037 already deleted. [ 660.047782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47cf1f6a-a532-4318-96e2-9315800a0037" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.781108] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-207 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.781108] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.781108] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.781108] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.782890] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.782890] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.782890] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.782890] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.782890] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.782890] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 660.783253] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 660.783607] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 660.783785] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 660.784057] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 660.784383] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 660.784482] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 660.818062] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 660.818062] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 660.818062] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 660.818062] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.818062] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-ea8b5988-95e7-4a5b-b062-03d4d72eb9e5 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.818062] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-ea8b5988-95e7-4a5b-b062-03d4d72eb9e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.818062] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-ea8b5988-95e7-4a5b-b062-03d4d72eb9e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.818062] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-ea8b5988-95e7-4a5b-b062-03d4d72eb9e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.818062] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea8b5988-95e7-4a5b-b062-03d4d72eb9e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.324083] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.324657] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.324657] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.324825] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.324917] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.325093] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port ea8b5988-95e7-4a5b-b062-03d4d72eb9e5 not found, creating... [ 661.325378] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.325587] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.325660] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.326067] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.326067] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.327227] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.327227] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.327227] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.327227] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.332597] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.332597] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: ea8b5988-95e7-4a5b-b062-03d4d72eb9e5 is going to be created. [ 661.374863] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.374863] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.374863] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.374863] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.374863] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.374863] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-ea8b5988-95e7-4a5b-b062-03d4d72eb9e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.610789] env[69920]: INFO networking_nsxv3.common.synchronization [None req-06f0b1f2-96a9-4a0a-80cc-acc228e8e2e2 None None] Enqueued Resource ID: 6f22eb83-ae8e-49bf-b811-178394b5ad67 with Priority: HIGHEST for action port [ 661.611012] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f22eb83-ae8e-49bf-b811-178394b5ad67 with Priority: HIGHEST for action port [ 661.611686] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f22eb83-ae8e-49bf-b811-178394b5ad67 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.611817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f22eb83-ae8e-49bf-b811-178394b5ad67" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.611886] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f22eb83-ae8e-49bf-b811-178394b5ad67" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.615517] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f22eb83-ae8e-49bf-b811-178394b5ad67" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.615611] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f22eb83-ae8e-49bf-b811-178394b5ad67',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.771519] env[69920]: INFO networking_nsxv3.common.synchronization [req-730ad7ac-ee2b-45f2-abab-e595487d424d req-41ddcd62-82f1-4855-85f4-515e5ac514d9 tempest-DeleteServersAdminTestJSON-1107524716 tempest-DeleteServersAdminTestJSON-1107524716-project-member] Enqueued Resource ID: c27221ee-5342-4aa7-83da-a28291a2021a with Priority: HIGHEST for action security_group_members [ 661.772612] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27221ee-5342-4aa7-83da-a28291a2021a with Priority: HIGHEST for action security_group_members [ 661.772612] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27221ee-5342-4aa7-83da-a28291a2021a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.772612] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.772791] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.773272] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.773949] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.774246] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.774606] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.774994] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.775313] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.775692] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c27221ee-5342-4aa7-83da-a28291a2021a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.122032] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f22eb83-ae8e-49bf-b811-178394b5ad67 [ 662.122032] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.122032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.122032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.122032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.122032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.122032] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f22eb83-ae8e-49bf-b811-178394b5ad67 already deleted. [ 662.122032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f22eb83-ae8e-49bf-b811-178394b5ad67" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.284624] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.284900] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.284900] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.285374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.285374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.285749] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.285749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.285749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.286756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.286756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.286756] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c27221ee-5342-4aa7-83da-a28291a2021a already deleted. [ 662.286756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.801464] env[69920]: INFO networking_nsxv3.common.synchronization [req-ebe4c8c3-6baf-436c-a0c8-589f63e523ee req-e7fde3e3-2b22-429b-9f9c-1299bed9b43e service nova] Enqueued Resource ID: 667ad5b8-40a7-4438-a71d-51999e9b972e with Priority: HIGHEST for action security_group_rules [ 662.801464] env[69920]: INFO networking_nsxv3.common.synchronization [req-ebe4c8c3-6baf-436c-a0c8-589f63e523ee req-e7fde3e3-2b22-429b-9f9c-1299bed9b43e service nova] Enqueued Resource ID: 667ad5b8-40a7-4438-a71d-51999e9b972e with Priority: HIGHEST for action security_group_members [ 662.801464] env[69920]: INFO networking_nsxv3.common.synchronization [req-ebe4c8c3-6baf-436c-a0c8-589f63e523ee req-e7fde3e3-2b22-429b-9f9c-1299bed9b43e service nova] Enqueued Resource ID: ea8b5988-95e7-4a5b-b062-03d4d72eb9e5 with Priority: HIGHEST for action port [ 662.802647] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 667ad5b8-40a7-4438-a71d-51999e9b972e with Priority: HIGHEST for action security_group_rules [ 662.804471] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 667ad5b8-40a7-4438-a71d-51999e9b972e with Priority: HIGHEST for action security_group_members [ 662.804471] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea8b5988-95e7-4a5b-b062-03d4d72eb9e5 with Priority: HIGHEST for action port [ 662.804471] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-667ad5b8-40a7-4438-a71d-51999e9b972e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.804471] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.804471] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.804471] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.804471] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('667ad5b8-40a7-4438-a71d-51999e9b972e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.807542] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-667ad5b8-40a7-4438-a71d-51999e9b972e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.808282] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.808526] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.810258] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.810258] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.810258] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.810258] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.810258] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.810258] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.810258] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('667ad5b8-40a7-4438-a71d-51999e9b972e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.812420] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea8b5988-95e7-4a5b-b062-03d4d72eb9e5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.813311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea8b5988-95e7-4a5b-b062-03d4d72eb9e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.813522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea8b5988-95e7-4a5b-b062-03d4d72eb9e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.813804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea8b5988-95e7-4a5b-b062-03d4d72eb9e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.814032] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea8b5988-95e7-4a5b-b062-03d4d72eb9e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.970282] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-207 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.970479] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.970956] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.970956] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.971125] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.971282] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.972593] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.972844] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.973287] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.973321] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 662.973605] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.973605] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.973718] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.973752] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 662.973841] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.974464] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.996644] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.996744] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 662.996861] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.997316] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.997743] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-8ed32df7-4147-4bf4-bedd-196b87bbea4d taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.997858] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-8ed32df7-4147-4bf4-bedd-196b87bbea4d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.998016] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-8ed32df7-4147-4bf4-bedd-196b87bbea4d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.998312] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-8ed32df7-4147-4bf4-bedd-196b87bbea4d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.998459] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ed32df7-4147-4bf4-bedd-196b87bbea4d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.308582] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-667ad5b8-40a7-4438-a71d-51999e9b972e taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.308731] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.315767] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('667ad5b8-40a7-4438-a71d-51999e9b972e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.316730] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea8b5988-95e7-4a5b-b062-03d4d72eb9e5 with status ACTIVE [ 663.316959] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.317100] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.317161] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.317377] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.317513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.317641] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.317741] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.317805] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.318238] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.318238] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.318238] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.318430] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.318430] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.318540] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.318584] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.318660] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea8b5988-95e7-4a5b-b062-03d4d72eb9e5 is going to be updated. [ 663.344103] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.344103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.344103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.344103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.344103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.344103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea8b5988-95e7-4a5b-b062-03d4d72eb9e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.501741] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.502134] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.502767] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.503654] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.503780] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.503944] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 8ed32df7-4147-4bf4-bedd-196b87bbea4d not found, creating... [ 663.504416] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.504501] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.504634] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.504883] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.507087] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.508019] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.508520] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.508899] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.509342] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.511440] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.511440] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 8ed32df7-4147-4bf4-bedd-196b87bbea4d is going to be created. [ 663.533782] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.535172] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.538212] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.538212] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.538212] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.538212] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-8ed32df7-4147-4bf4-bedd-196b87bbea4d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.719905] env[69920]: INFO networking_nsxv3.common.synchronization [None req-54f9b4ef-9e98-41ab-b394-1d08a44281cc None None] Enqueued Resource ID: f16eda9e-6ca7-4b5c-bb85-fe5467b1a96d with Priority: HIGHEST for action port [ 663.719905] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f16eda9e-6ca7-4b5c-bb85-fe5467b1a96d with Priority: HIGHEST for action port [ 663.719905] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-f16eda9e-6ca7-4b5c-bb85-fe5467b1a96d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.719905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f16eda9e-6ca7-4b5c-bb85-fe5467b1a96d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.719905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f16eda9e-6ca7-4b5c-bb85-fe5467b1a96d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.722117] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f16eda9e-6ca7-4b5c-bb85-fe5467b1a96d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.722117] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f16eda9e-6ca7-4b5c-bb85-fe5467b1a96d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.822643] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('667ad5b8-40a7-4438-a71d-51999e9b972e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.225281] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f16eda9e-6ca7-4b5c-bb85-fe5467b1a96d [ 664.226248] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.229434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.229434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.229434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.230329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.230329] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f16eda9e-6ca7-4b5c-bb85-fe5467b1a96d already deleted. [ 664.230329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f16eda9e-6ca7-4b5c-bb85-fe5467b1a96d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.329457] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.329805] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.329892] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.330350] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.330955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.331166] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 667ad5b8-40a7-4438-a71d-51999e9b972e is going to be created. [ 664.360661] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.360661] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.360661] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.360661] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.360661] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.371335] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 667ad5b8-40a7-4438-a71d-51999e9b972e in Status: UNINITIALIZED for 2s [ 665.036719] env[69920]: INFO networking_nsxv3.common.synchronization [None req-9fcee70e-86a4-4555-9b95-375aea810db7 None None] Enqueued Resource ID: a78838ec-05b9-40ea-9cf3-5ed4f90cbbc8 with Priority: HIGHEST for action port [ 665.037052] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a78838ec-05b9-40ea-9cf3-5ed4f90cbbc8 with Priority: HIGHEST for action port [ 665.038078] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-a78838ec-05b9-40ea-9cf3-5ed4f90cbbc8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.038078] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a78838ec-05b9-40ea-9cf3-5ed4f90cbbc8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.038078] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a78838ec-05b9-40ea-9cf3-5ed4f90cbbc8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.038078] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a78838ec-05b9-40ea-9cf3-5ed4f90cbbc8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.038078] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a78838ec-05b9-40ea-9cf3-5ed4f90cbbc8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.212195] env[69920]: INFO networking_nsxv3.common.synchronization [req-05effcaf-9d7b-4350-94c4-7ea86a3d4830 req-d45aeae2-f9ba-40bd-b7be-bcde6a716d37 tempest-ImagesNegativeTestJSON-1748246780 tempest-ImagesNegativeTestJSON-1748246780-project-member] Enqueued Resource ID: 5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc with Priority: HIGHEST for action security_group_members [ 665.212195] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc with Priority: HIGHEST for action security_group_members [ 665.212439] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.213991] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.215046] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.215046] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.215046] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.215046] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.215046] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.215308] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.215308] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.215414] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.358967] env[69920]: INFO networking_nsxv3.common.synchronization [req-730ad7ac-ee2b-45f2-abab-e595487d424d req-77557471-992e-4bfd-acef-22dbcb0763ef service nova] Enqueued Resource ID: c27221ee-5342-4aa7-83da-a28291a2021a with Priority: HIGHEST for action security_group_rules [ 665.358967] env[69920]: INFO networking_nsxv3.common.synchronization [req-730ad7ac-ee2b-45f2-abab-e595487d424d req-77557471-992e-4bfd-acef-22dbcb0763ef service nova] Enqueued Resource ID: c27221ee-5342-4aa7-83da-a28291a2021a with Priority: HIGHEST for action security_group_members [ 665.358967] env[69920]: INFO networking_nsxv3.common.synchronization [req-730ad7ac-ee2b-45f2-abab-e595487d424d req-77557471-992e-4bfd-acef-22dbcb0763ef service nova] Enqueued Resource ID: 8ed32df7-4147-4bf4-bedd-196b87bbea4d with Priority: HIGHEST for action port [ 665.359216] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27221ee-5342-4aa7-83da-a28291a2021a with Priority: HIGHEST for action security_group_rules [ 665.359499] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27221ee-5342-4aa7-83da-a28291a2021a with Priority: HIGHEST for action security_group_members [ 665.359499] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ed32df7-4147-4bf4-bedd-196b87bbea4d with Priority: HIGHEST for action port [ 665.359885] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c27221ee-5342-4aa7-83da-a28291a2021a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.360024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.360093] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.362378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.362378] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c27221ee-5342-4aa7-83da-a28291a2021a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.362378] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27221ee-5342-4aa7-83da-a28291a2021a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.362378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.362378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.362378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.362378] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.362378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.362378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.362378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.367461] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.371131] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c27221ee-5342-4aa7-83da-a28291a2021a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.371131] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ed32df7-4147-4bf4-bedd-196b87bbea4d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.371285] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ed32df7-4147-4bf4-bedd-196b87bbea4d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.371322] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ed32df7-4147-4bf4-bedd-196b87bbea4d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.371519] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ed32df7-4147-4bf4-bedd-196b87bbea4d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.371584] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ed32df7-4147-4bf4-bedd-196b87bbea4d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.541321] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a78838ec-05b9-40ea-9cf3-5ed4f90cbbc8 [ 665.541556] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.541687] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.541753] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.541999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.542106] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.542952] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a78838ec-05b9-40ea-9cf3-5ed4f90cbbc8 already deleted. [ 665.542952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a78838ec-05b9-40ea-9cf3-5ed4f90cbbc8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.603269] env[69920]: INFO networking_nsxv3.common.synchronization [None req-e82af8e5-619b-4e47-8363-d283ebad0270 None None] Enqueued Resource ID: e45b3990-56cb-4c97-b7ad-58f9810bf805 with Priority: HIGHEST for action port [ 665.603580] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e45b3990-56cb-4c97-b7ad-58f9810bf805 with Priority: HIGHEST for action port [ 665.604319] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-e45b3990-56cb-4c97-b7ad-58f9810bf805 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.604319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e45b3990-56cb-4c97-b7ad-58f9810bf805" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.604319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e45b3990-56cb-4c97-b7ad-58f9810bf805" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.605080] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e45b3990-56cb-4c97-b7ad-58f9810bf805" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.605080] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e45b3990-56cb-4c97-b7ad-58f9810bf805',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.719862] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.719862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.719862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.719862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.719862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.719862] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.719862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.719862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.719862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.719862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.719862] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc already deleted. [ 665.719862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.877236] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27221ee-5342-4aa7-83da-a28291a2021a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.877236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.892887] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ed32df7-4147-4bf4-bedd-196b87bbea4d with status ACTIVE [ 665.893416] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.893531] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.893531] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.893753] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.893850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.894235] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.894323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.894390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.894593] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.894711] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.894921] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.895031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.895031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.895257] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.895311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.895390] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ed32df7-4147-4bf4-bedd-196b87bbea4d is going to be updated. [ 665.903502] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c27221ee-5342-4aa7-83da-a28291a2021a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.930691] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.930913] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.930975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.931322] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.931511] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.931740] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ed32df7-4147-4bf4-bedd-196b87bbea4d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.109602] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e45b3990-56cb-4c97-b7ad-58f9810bf805 [ 666.109993] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.110144] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.110315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.110529] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.110616] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.110663] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e45b3990-56cb-4c97-b7ad-58f9810bf805 already deleted. [ 666.110718] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e45b3990-56cb-4c97-b7ad-58f9810bf805" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.385125] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 667ad5b8-40a7-4438-a71d-51999e9b972e in Status: SUCCESS [ 666.387687] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.387687] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.387687] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.387687] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.387687] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.387687] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.387687] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.387687] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.387687] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.387687] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('667ad5b8-40a7-4438-a71d-51999e9b972e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.405287] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c27221ee-5342-4aa7-83da-a28291a2021a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.818648] env[69920]: INFO networking_nsxv3.common.synchronization [req-befbc9ca-5067-40d0-8483-84e0ecfc6e20 req-d77cee37-b5e1-4b22-af74-a1cffaca1aa1 tempest-ImagesOneServerTestJSON-280648197 tempest-ImagesOneServerTestJSON-280648197-project-member] Enqueued Resource ID: 156af133-c5cb-4af5-87be-b21d4422308a with Priority: HIGHEST for action security_group_members [ 666.819239] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156af133-c5cb-4af5-87be-b21d4422308a with Priority: HIGHEST for action security_group_members [ 666.819534] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-156af133-c5cb-4af5-87be-b21d4422308a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.819690] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.819792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.820264] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.820792] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.820909] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.821022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.822259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.822259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.825114] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156af133-c5cb-4af5-87be-b21d4422308a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.890498] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-667ad5b8-40a7-4438-a71d-51999e9b972e taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.891355] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.891465] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.891656] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.892153] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.892153] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.892153] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.892305] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.892305] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.892393] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.892491] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-667ad5b8-40a7-4438-a71d-51999e9b972e taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.892579] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.892634] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.894016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.894677] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.895175] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.895464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.895746] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.896934] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.897142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.897316] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('667ad5b8-40a7-4438-a71d-51999e9b972e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.912459] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.912459] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.912459] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.912459] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.912459] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.912459] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c27221ee-5342-4aa7-83da-a28291a2021a is going to be created. [ 666.938978] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.939147] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.939215] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.939443] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.939603] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.950198] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27221ee-5342-4aa7-83da-a28291a2021a in Status: UNINITIALIZED for 2s [ 667.045056] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-307 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.045404] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-307" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.045404] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-307" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.045702] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-307" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.045958] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.047551] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.047698] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.047988] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.048180] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.048390] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 667.048504] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 667.048642] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 667.048797] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 667.048860] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 667.048919] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 667.049108] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 667.073433] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 667.073433] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 667.073433] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 667.073433] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-307" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.073433] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-4df42787-eead-48f3-a537-5f3f2a36a836 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.073633] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-4df42787-eead-48f3-a537-5f3f2a36a836" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.073761] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-4df42787-eead-48f3-a537-5f3f2a36a836" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.074171] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-4df42787-eead-48f3-a537-5f3f2a36a836" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.075036] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4df42787-eead-48f3-a537-5f3f2a36a836',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.326424] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.326738] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.326738] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.326897] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.327016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.327368] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.327368] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.327450] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.327632] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.327710] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.327745] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156af133-c5cb-4af5-87be-b21d4422308a already deleted. [ 667.327832] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.400942] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 667ad5b8-40a7-4438-a71d-51999e9b972e: rpc.has_security_group_logging(os_id): False [ 667.424285] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.424454] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.424530] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.424705] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.424799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.424980] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.425846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.425846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.425846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.425846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.425846] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.425846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.425846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.426133] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.426133] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.428152] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.428152] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.428152] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.428152] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.428362] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.428362] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 667ad5b8-40a7-4438-a71d-51999e9b972e is going to be created. [ 667.497044] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.497233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.497303] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.497555] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.497834] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.511166] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 667ad5b8-40a7-4438-a71d-51999e9b972e in Status: IN_PROGRESS for 2s [ 667.580883] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.581312] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.581491] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.581815] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.581983] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.582172] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 4df42787-eead-48f3-a537-5f3f2a36a836 not found, creating... [ 667.582722] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.582843] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.582920] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.583361] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.583559] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.583973] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.584593] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.584817] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.585092] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.585250] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.585429] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 4df42787-eead-48f3-a537-5f3f2a36a836 is going to be created. [ 667.612699] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.613574] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.614398] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.615602] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.615602] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.616897] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-4df42787-eead-48f3-a537-5f3f2a36a836" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.870356] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-847 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.871116] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-847" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.871198] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-847" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.871582] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-847" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.871928] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.872940] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.873225] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.873528] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.874171] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.874171] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 667.874171] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 667.876347] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 667.876584] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 667.876777] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 667.877091] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 667.877159] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 667.905739] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 667.906485] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 667.906485] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 667.906485] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-847" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.906687] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-ee4c8bc2-33ea-425e-adbc-5a75ab428943 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.906793] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-ee4c8bc2-33ea-425e-adbc-5a75ab428943" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.906930] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-ee4c8bc2-33ea-425e-adbc-5a75ab428943" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.907328] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-ee4c8bc2-33ea-425e-adbc-5a75ab428943" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.907479] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee4c8bc2-33ea-425e-adbc-5a75ab428943',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.119630] env[69920]: INFO networking_nsxv3.common.synchronization [None req-1ae9a784-d9c0-4b11-960e-43044191f42e None None] Enqueued Resource ID: 039aca15-ae33-48a4-b5d1-de2e26d7041e with Priority: HIGHEST for action port [ 668.120378] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 039aca15-ae33-48a4-b5d1-de2e26d7041e with Priority: HIGHEST for action port [ 668.122032] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-039aca15-ae33-48a4-b5d1-de2e26d7041e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.122032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-039aca15-ae33-48a4-b5d1-de2e26d7041e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.122032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-039aca15-ae33-48a4-b5d1-de2e26d7041e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.122032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-039aca15-ae33-48a4-b5d1-de2e26d7041e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.122032] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('039aca15-ae33-48a4-b5d1-de2e26d7041e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.410894] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.411442] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.411766] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.412023] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.412442] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.412642] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port ee4c8bc2-33ea-425e-adbc-5a75ab428943 not found, creating... [ 668.413798] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.414052] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.414201] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.414505] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.414909] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.415117] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.415791] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.415791] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.415791] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.415791] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.416147] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: ee4c8bc2-33ea-425e-adbc-5a75ab428943 is going to be created. [ 668.441558] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.443184] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.443184] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.443367] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.444065] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.444686] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-ee4c8bc2-33ea-425e-adbc-5a75ab428943" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.623759] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 039aca15-ae33-48a4-b5d1-de2e26d7041e [ 668.623759] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.623759] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.623982] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.624510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.624510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.624510] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:039aca15-ae33-48a4-b5d1-de2e26d7041e already deleted. [ 668.624510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-039aca15-ae33-48a4-b5d1-de2e26d7041e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.666245] env[69920]: INFO networking_nsxv3.common.synchronization [None req-a6ce23e9-eda1-4627-a1cb-15561cc97d1e tempest-VolumesAssistedSnapshotsTest-131898001 tempest-VolumesAssistedSnapshotsTest-131898001-project-member] Enqueued Resource ID: b6124cb4-db5b-4093-b85f-7d68bc614215 with Priority: HIGHEST for action security_group_rules [ 668.667024] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6124cb4-db5b-4093-b85f-7d68bc614215 with Priority: HIGHEST for action security_group_rules [ 668.667394] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6124cb4-db5b-4093-b85f-7d68bc614215 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.668712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.668712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.668712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.668712] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6124cb4-db5b-4093-b85f-7d68bc614215',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.954540] env[69920]: INFO networking_nsxv3.common.synchronization [None req-13a0c7a6-3425-41d8-8568-33af6ad2ba34 tempest-VolumesAssistedSnapshotsTest-131898001 tempest-VolumesAssistedSnapshotsTest-131898001-project-member] Enqueued Resource ID: b6124cb4-db5b-4093-b85f-7d68bc614215 with Priority: HIGHEST for action security_group_rules [ 668.955359] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6124cb4-db5b-4093-b85f-7d68bc614215 with Priority: HIGHEST for action security_group_rules [ 668.955913] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6124cb4-db5b-4093-b85f-7d68bc614215 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.955913] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.966209] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27221ee-5342-4aa7-83da-a28291a2021a in Status: SUCCESS [ 668.967079] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.968283] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.969357] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.969776] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.971016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.971016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.971016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.971016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.971016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.971016] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c27221ee-5342-4aa7-83da-a28291a2021a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.984689] env[69920]: INFO networking_nsxv3.common.synchronization [None req-a634067b-9b48-4555-9c62-62db48706ac9 None None] Enqueued Resource ID: aadbe74e-842d-41d8-b731-cb27ee69e0e8 with Priority: HIGHEST for action port [ 668.987787] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aadbe74e-842d-41d8-b731-cb27ee69e0e8 with Priority: HIGHEST for action port [ 668.987787] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-aadbe74e-842d-41d8-b731-cb27ee69e0e8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.987787] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aadbe74e-842d-41d8-b731-cb27ee69e0e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.987787] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aadbe74e-842d-41d8-b731-cb27ee69e0e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.987787] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aadbe74e-842d-41d8-b731-cb27ee69e0e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.987787] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aadbe74e-842d-41d8-b731-cb27ee69e0e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.027900] env[69920]: INFO networking_nsxv3.common.synchronization [req-05effcaf-9d7b-4350-94c4-7ea86a3d4830 req-e11c487b-9fed-4358-8914-956cb45517ca service nova] Enqueued Resource ID: 5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc with Priority: HIGHEST for action security_group_rules [ 669.028172] env[69920]: INFO networking_nsxv3.common.synchronization [req-05effcaf-9d7b-4350-94c4-7ea86a3d4830 req-e11c487b-9fed-4358-8914-956cb45517ca service nova] Enqueued Resource ID: 5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc with Priority: HIGHEST for action security_group_members [ 669.028281] env[69920]: INFO networking_nsxv3.common.synchronization [req-05effcaf-9d7b-4350-94c4-7ea86a3d4830 req-e11c487b-9fed-4358-8914-956cb45517ca service nova] Enqueued Resource ID: 4df42787-eead-48f3-a537-5f3f2a36a836 with Priority: HIGHEST for action port [ 669.028751] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc with Priority: HIGHEST for action security_group_rules [ 669.028921] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc with Priority: HIGHEST for action security_group_members [ 669.029390] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4df42787-eead-48f3-a537-5f3f2a36a836 with Priority: HIGHEST for action port [ 669.030097] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.030715] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.030875] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.031217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.033681] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.033681] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.033681] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.033681] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.033681] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.033681] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.033681] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.033681] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.034115] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.034309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.034436] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.035713] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-4df42787-eead-48f3-a537-5f3f2a36a836 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.035871] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4df42787-eead-48f3-a537-5f3f2a36a836" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.035959] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4df42787-eead-48f3-a537-5f3f2a36a836" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.036225] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4df42787-eead-48f3-a537-5f3f2a36a836" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.036334] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4df42787-eead-48f3-a537-5f3f2a36a836',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.186722] env[69920]: INFO networking_nsxv3.common.synchronization [None req-e9b44ee5-234b-49cc-b4ba-31ed97802162 None None] Enqueued Resource ID: c369b844-ace8-449e-93f4-9558dfd50981 with Priority: HIGHEST for action port [ 669.186993] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c369b844-ace8-449e-93f4-9558dfd50981 with Priority: HIGHEST for action port [ 669.187672] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-c369b844-ace8-449e-93f4-9558dfd50981 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.187846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c369b844-ace8-449e-93f4-9558dfd50981" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.187911] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c369b844-ace8-449e-93f4-9558dfd50981" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.192296] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c369b844-ace8-449e-93f4-9558dfd50981" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.192400] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c369b844-ace8-449e-93f4-9558dfd50981',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.194314] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.194502] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.194572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.194793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.194793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.194957] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6124cb4-db5b-4093-b85f-7d68bc614215 already deleted. [ 669.194957] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.196226] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.197564] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.198819] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6124cb4-db5b-4093-b85f-7d68bc614215',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.358081] env[69920]: INFO networking_nsxv3.common.synchronization [req-6dd03dbb-75f7-418f-8250-c5990d740aac req-7772f0a5-63da-4b45-8136-806b7dd960f5 tempest-MigrationsAdminTest-685805879 tempest-MigrationsAdminTest-685805879-project-member] Enqueued Resource ID: 6440e2db-5336-4fd7-b450-468fa8f78560 with Priority: HIGHEST for action security_group_members [ 669.358590] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6440e2db-5336-4fd7-b450-468fa8f78560 with Priority: HIGHEST for action security_group_members [ 669.358886] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6440e2db-5336-4fd7-b450-468fa8f78560 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.359019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.359249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.359329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.359479] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.359582] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.359643] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.359792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.359875] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.359964] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6440e2db-5336-4fd7-b450-468fa8f78560',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.474239] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27221ee-5342-4aa7-83da-a28291a2021a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.474548] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.474548] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.474690] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.474849] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.475014] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.475051] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.475240] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.475332] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.475558] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.475950] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27221ee-5342-4aa7-83da-a28291a2021a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.476064] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.476187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.476187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.476541] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.476932] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.476932] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.476932] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.477312] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.477312] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.477312] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c27221ee-5342-4aa7-83da-a28291a2021a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.489133] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aadbe74e-842d-41d8-b731-cb27ee69e0e8 [ 669.489661] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.489863] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.490065] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.490183] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.490357] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.490419] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aadbe74e-842d-41d8-b731-cb27ee69e0e8 already deleted. [ 669.490474] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aadbe74e-842d-41d8-b731-cb27ee69e0e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.538576] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4df42787-eead-48f3-a537-5f3f2a36a836 with status ACTIVE [ 669.538941] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.538941] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.539070] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.539778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.539778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.539778] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.539778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.539778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.539778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.540062] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.540062] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.540200] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.540200] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.540284] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.540363] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.540531] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4df42787-eead-48f3-a537-5f3f2a36a836 is going to be updated. [ 669.547870] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.547870] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.547870] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.553981] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 667ad5b8-40a7-4438-a71d-51999e9b972e in Status: SUCCESS [ 669.555151] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.579566] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.579738] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.579738] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.580042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.580158] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.580319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4df42787-eead-48f3-a537-5f3f2a36a836" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.702468] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c369b844-ace8-449e-93f4-9558dfd50981 [ 669.702468] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.702468] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.702468] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.702468] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.702468] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.702468] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c369b844-ace8-449e-93f4-9558dfd50981 already deleted. [ 669.702468] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c369b844-ace8-449e-93f4-9558dfd50981" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.720635] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.720635] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.720635] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.720635] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.720635] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.720635] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6124cb4-db5b-4093-b85f-7d68bc614215 already deleted. [ 669.720635] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.865245] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.865245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.865245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.865245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.865245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.865245] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.865245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.865245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.865541] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.865570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.866055] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6440e2db-5336-4fd7-b450-468fa8f78560 already deleted. [ 669.866302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.979371] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c27221ee-5342-4aa7-83da-a28291a2021a: rpc.has_security_group_logging(os_id): False [ 669.999900] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.999900] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.000069] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.000275] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.000435] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.000847] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.000847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.000847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.001014] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.001232] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.001303] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.001374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.001469] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.001625] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.001748] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.001964] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.006353] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.006353] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.006353] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.006353] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.006353] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c27221ee-5342-4aa7-83da-a28291a2021a is going to be created. [ 670.051986] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.074764] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.074866] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.074940] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.075192] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.075399] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.089251] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c27221ee-5342-4aa7-83da-a28291a2021a in Status: IN_PROGRESS for 2s [ 670.219218] env[69920]: INFO networking_nsxv3.common.synchronization [req-befbc9ca-5067-40d0-8483-84e0ecfc6e20 req-cc612e06-938b-4194-b102-5df16fc6ed07 service nova] Enqueued Resource ID: 156af133-c5cb-4af5-87be-b21d4422308a with Priority: HIGHEST for action security_group_rules [ 670.219556] env[69920]: INFO networking_nsxv3.common.synchronization [req-befbc9ca-5067-40d0-8483-84e0ecfc6e20 req-cc612e06-938b-4194-b102-5df16fc6ed07 service nova] Enqueued Resource ID: 156af133-c5cb-4af5-87be-b21d4422308a with Priority: HIGHEST for action security_group_members [ 670.219634] env[69920]: INFO networking_nsxv3.common.synchronization [req-befbc9ca-5067-40d0-8483-84e0ecfc6e20 req-cc612e06-938b-4194-b102-5df16fc6ed07 service nova] Enqueued Resource ID: ee4c8bc2-33ea-425e-adbc-5a75ab428943 with Priority: HIGHEST for action port [ 670.220200] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156af133-c5cb-4af5-87be-b21d4422308a with Priority: HIGHEST for action security_group_rules [ 670.220395] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156af133-c5cb-4af5-87be-b21d4422308a with Priority: HIGHEST for action security_group_members [ 670.220530] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee4c8bc2-33ea-425e-adbc-5a75ab428943 with Priority: HIGHEST for action port [ 670.223167] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-156af133-c5cb-4af5-87be-b21d4422308a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.223319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.223559] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.223731] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.223939] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('156af133-c5cb-4af5-87be-b21d4422308a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.225140] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-156af133-c5cb-4af5-87be-b21d4422308a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.225272] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.225341] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.225538] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.225827] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.225910] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.225958] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.229500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.229549] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.229666] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156af133-c5cb-4af5-87be-b21d4422308a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.230808] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee4c8bc2-33ea-425e-adbc-5a75ab428943 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.230925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee4c8bc2-33ea-425e-adbc-5a75ab428943" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.231162] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee4c8bc2-33ea-425e-adbc-5a75ab428943" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.231494] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee4c8bc2-33ea-425e-adbc-5a75ab428943" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.231494] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee4c8bc2-33ea-425e-adbc-5a75ab428943',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.316784] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-207 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.316784] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.316784] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.316784] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.316784] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.316784] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.316784] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.317278] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.317544] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.317616] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 670.320413] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 670.320413] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 670.320413] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 670.320413] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 670.320413] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 670.320413] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 670.341023] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 670.341023] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 670.341023] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 670.341023] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.341023] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-67c7df0a-bb67-40ee-9a2d-11cea9dbacb7 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.341023] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-67c7df0a-bb67-40ee-9a2d-11cea9dbacb7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.341023] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-67c7df0a-bb67-40ee-9a2d-11cea9dbacb7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.341023] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-67c7df0a-bb67-40ee-9a2d-11cea9dbacb7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.341023] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67c7df0a-bb67-40ee-9a2d-11cea9dbacb7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.561165] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.561165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.561165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.561546] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.561546] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.561546] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc is going to be created. [ 670.596307] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.596454] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.596522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.596735] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.596897] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.608106] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc in Status: UNINITIALIZED for 2s [ 670.693180] env[69920]: INFO networking_nsxv3.common.synchronization [None req-82c01d3d-c773-40fc-aa48-a5cf01f79741 None None] Enqueued Resource ID: beed1037-d1f5-4e54-b9cd-c401877c4b4a with Priority: HIGHEST for action port [ 670.693756] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beed1037-d1f5-4e54-b9cd-c401877c4b4a with Priority: HIGHEST for action port [ 670.694147] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-beed1037-d1f5-4e54-b9cd-c401877c4b4a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.694307] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-beed1037-d1f5-4e54-b9cd-c401877c4b4a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.694373] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-beed1037-d1f5-4e54-b9cd-c401877c4b4a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.694592] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-beed1037-d1f5-4e54-b9cd-c401877c4b4a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.694694] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('beed1037-d1f5-4e54-b9cd-c401877c4b4a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.733027] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-156af133-c5cb-4af5-87be-b21d4422308a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.733186] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.733568] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('156af133-c5cb-4af5-87be-b21d4422308a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.738030] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee4c8bc2-33ea-425e-adbc-5a75ab428943 with status ACTIVE [ 670.738237] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.739128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.739128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.739128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.739128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.739255] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.741020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.741020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.741020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.741020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.741020] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.741020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.741020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.741020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.741020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.741020] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee4c8bc2-33ea-425e-adbc-5a75ab428943 is going to be updated. [ 670.766010] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.766010] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.766382] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.766382] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.766448] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.766777] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee4c8bc2-33ea-425e-adbc-5a75ab428943" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.845911] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.846109] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.846324] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.846554] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.846740] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.846905] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 67c7df0a-bb67-40ee-9a2d-11cea9dbacb7 not found, creating... [ 670.847132] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.847334] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.847912] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.847912] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.847912] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.848188] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.848271] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.848328] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.848523] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.848660] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.848801] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 67c7df0a-bb67-40ee-9a2d-11cea9dbacb7 is going to be created. [ 670.879617] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.879617] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.879617] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.879617] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.879617] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.879617] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-67c7df0a-bb67-40ee-9a2d-11cea9dbacb7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.201258] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port beed1037-d1f5-4e54-b9cd-c401877c4b4a [ 671.201258] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.201258] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.201258] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.201258] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.201258] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.201258] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:beed1037-d1f5-4e54-b9cd-c401877c4b4a already deleted. [ 671.201258] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-beed1037-d1f5-4e54-b9cd-c401877c4b4a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.236821] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('156af133-c5cb-4af5-87be-b21d4422308a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.741545] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.741897] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.741897] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.741985] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.742186] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.742302] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156af133-c5cb-4af5-87be-b21d4422308a is going to be created. [ 671.772992] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.773214] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.774144] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.774424] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.774595] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.789797] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156af133-c5cb-4af5-87be-b21d4422308a in Status: UNINITIALIZED for 2s [ 672.103442] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c27221ee-5342-4aa7-83da-a28291a2021a in Status: SUCCESS [ 672.103963] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.582492] env[69920]: INFO networking_nsxv3.common.synchronization [None req-c0124728-bd33-4209-a142-8375343c0c57 None None] Enqueued Resource ID: a4a2dabb-832d-4738-911b-b8e6ab564b46 with Priority: HIGHEST for action port [ 672.586012] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4a2dabb-832d-4738-911b-b8e6ab564b46 with Priority: HIGHEST for action port [ 672.586012] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4a2dabb-832d-4738-911b-b8e6ab564b46 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.586012] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4a2dabb-832d-4738-911b-b8e6ab564b46" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.586012] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4a2dabb-832d-4738-911b-b8e6ab564b46" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.586012] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4a2dabb-832d-4738-911b-b8e6ab564b46" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.586012] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4a2dabb-832d-4738-911b-b8e6ab564b46',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.619751] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc in Status: SUCCESS [ 672.619955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.620122] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.620434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.620543] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.620658] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.620718] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.620866] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.620943] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.621036] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.621127] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.631758] env[69920]: INFO networking_nsxv3.common.synchronization [req-6dd03dbb-75f7-418f-8250-c5990d740aac req-62dac5fe-c308-47dc-bd80-b51bdcb50ca9 service nova] Enqueued Resource ID: 6440e2db-5336-4fd7-b450-468fa8f78560 with Priority: HIGHEST for action security_group_rules [ 672.631758] env[69920]: INFO networking_nsxv3.common.synchronization [req-6dd03dbb-75f7-418f-8250-c5990d740aac req-62dac5fe-c308-47dc-bd80-b51bdcb50ca9 service nova] Enqueued Resource ID: 6440e2db-5336-4fd7-b450-468fa8f78560 with Priority: HIGHEST for action security_group_members [ 672.631758] env[69920]: INFO networking_nsxv3.common.synchronization [req-6dd03dbb-75f7-418f-8250-c5990d740aac req-62dac5fe-c308-47dc-bd80-b51bdcb50ca9 service nova] Enqueued Resource ID: 67c7df0a-bb67-40ee-9a2d-11cea9dbacb7 with Priority: HIGHEST for action port [ 672.632009] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6440e2db-5336-4fd7-b450-468fa8f78560 with Priority: HIGHEST for action security_group_rules [ 672.633368] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6440e2db-5336-4fd7-b450-468fa8f78560 with Priority: HIGHEST for action security_group_members [ 672.633517] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67c7df0a-bb67-40ee-9a2d-11cea9dbacb7 with Priority: HIGHEST for action port [ 672.633895] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6440e2db-5336-4fd7-b450-468fa8f78560 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.634061] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.634147] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.634425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.634505] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6440e2db-5336-4fd7-b450-468fa8f78560',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.635339] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6440e2db-5336-4fd7-b450-468fa8f78560 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.635452] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.635510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.635699] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.637510] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.637510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.637510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.637510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.637510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.637510] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6440e2db-5336-4fd7-b450-468fa8f78560',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.644280] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-67c7df0a-bb67-40ee-9a2d-11cea9dbacb7 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.644280] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67c7df0a-bb67-40ee-9a2d-11cea9dbacb7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.644280] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67c7df0a-bb67-40ee-9a2d-11cea9dbacb7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.644280] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67c7df0a-bb67-40ee-9a2d-11cea9dbacb7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.644280] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67c7df0a-bb67-40ee-9a2d-11cea9dbacb7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.942583] env[69920]: INFO networking_nsxv3.common.synchronization [None req-7e2b8c8e-b37e-42b2-bf13-ae1d52312f95 None None] Enqueued Resource ID: 1d821747-9fe3-458d-ad96-a2eec6a37a73 with Priority: HIGHEST for action port [ 672.942826] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d821747-9fe3-458d-ad96-a2eec6a37a73 with Priority: HIGHEST for action port [ 672.943479] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d821747-9fe3-458d-ad96-a2eec6a37a73 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.943668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d821747-9fe3-458d-ad96-a2eec6a37a73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.943774] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d821747-9fe3-458d-ad96-a2eec6a37a73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.946529] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d821747-9fe3-458d-ad96-a2eec6a37a73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.946684] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d821747-9fe3-458d-ad96-a2eec6a37a73',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.087027] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a4a2dabb-832d-4738-911b-b8e6ab564b46 [ 673.087027] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.087027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.087027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.089025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.089025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.089025] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a4a2dabb-832d-4738-911b-b8e6ab564b46 already deleted. [ 673.089025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4a2dabb-832d-4738-911b-b8e6ab564b46" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.127420] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.127420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.127420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.127420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.127420] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.127420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.127420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.127420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.127420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.127420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.127420] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.127420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.127420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.127420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.127420] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.127420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.128500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.128500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.128500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.128500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.128500] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.148023] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6440e2db-5336-4fd7-b450-468fa8f78560 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.148023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.148023] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6440e2db-5336-4fd7-b450-468fa8f78560',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.148023] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 67c7df0a-bb67-40ee-9a2d-11cea9dbacb7 with status ACTIVE [ 673.148023] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.148023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.148023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.148023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.148023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.148023] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.148023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.148023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.148023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.148023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.148819] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.148819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.148819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.148819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.148819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.149869] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 67c7df0a-bb67-40ee-9a2d-11cea9dbacb7 is going to be updated. [ 673.182476] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.182636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.182707] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.182928] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.183129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.183319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67c7df0a-bb67-40ee-9a2d-11cea9dbacb7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.452641] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1d821747-9fe3-458d-ad96-a2eec6a37a73 [ 673.452641] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.452641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.452641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.452641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.452641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.452641] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1d821747-9fe3-458d-ad96-a2eec6a37a73 already deleted. [ 673.452641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d821747-9fe3-458d-ad96-a2eec6a37a73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.631473] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc: rpc.has_security_group_logging(os_id): False [ 673.649724] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.649900] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.649947] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.650181] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.650310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.650620] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.650788] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.650898] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.651310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.651449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.652211] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.652647] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.652727] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.652897] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.652976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.653276] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.653386] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.653429] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.653578] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.653713] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.653750] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc is going to be created. [ 673.654923] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6440e2db-5336-4fd7-b450-468fa8f78560',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.718200] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.718200] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.718200] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.718200] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.718200] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.733137] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc in Status: IN_PROGRESS for 2s [ 673.804704] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156af133-c5cb-4af5-87be-b21d4422308a in Status: SUCCESS [ 673.806159] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.806159] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.806159] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.806159] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.806159] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.806159] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.806159] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.806159] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.806159] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.806159] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('156af133-c5cb-4af5-87be-b21d4422308a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.819108] env[69920]: INFO networking_nsxv3.common.synchronization [None req-a9044d04-9aae-45f7-8a41-2ad99bf32ff2 None None] Enqueued Resource ID: 81eb9364-69c4-4e1a-b312-f1042ae807e2 with Priority: HIGHEST for action port [ 673.819509] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81eb9364-69c4-4e1a-b312-f1042ae807e2 with Priority: HIGHEST for action port [ 673.820601] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-81eb9364-69c4-4e1a-b312-f1042ae807e2 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.820601] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81eb9364-69c4-4e1a-b312-f1042ae807e2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.820601] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81eb9364-69c4-4e1a-b312-f1042ae807e2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.820601] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81eb9364-69c4-4e1a-b312-f1042ae807e2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.820601] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81eb9364-69c4-4e1a-b312-f1042ae807e2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.020543] env[69920]: INFO networking_nsxv3.common.synchronization [None req-aa954204-cbf5-4439-ae83-2c78a286c5fb None None] Enqueued Resource ID: 6c098d26-24c9-45c9-86ed-e22e77625917 with Priority: HIGHEST for action port [ 674.020543] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c098d26-24c9-45c9-86ed-e22e77625917 with Priority: HIGHEST for action port [ 674.020543] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c098d26-24c9-45c9-86ed-e22e77625917 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.020543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c098d26-24c9-45c9-86ed-e22e77625917" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.020543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c098d26-24c9-45c9-86ed-e22e77625917" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.021245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c098d26-24c9-45c9-86ed-e22e77625917" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.021245] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c098d26-24c9-45c9-86ed-e22e77625917',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.148654] env[69920]: INFO networking_nsxv3.common.synchronization [req-195fe0ef-e0de-44b1-97c7-14f3f1626442 req-111e4709-c2b5-4a52-bfc4-fbb7a9fa261b tempest-ServersTestJSON-2147431032 tempest-ServersTestJSON-2147431032-project-member] Enqueued Resource ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 with Priority: HIGHEST for action security_group_members [ 674.153293] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 with Priority: HIGHEST for action security_group_members [ 674.153471] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e86ba42-7c29-4732-915b-33713b63d0b7 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.153874] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.155484] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.155647] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.159870] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.159870] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.159870] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.159870] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.159870] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.159870] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e86ba42-7c29-4732-915b-33713b63d0b7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.163446] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.165789] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.165789] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.165789] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.165789] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.165789] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6440e2db-5336-4fd7-b450-468fa8f78560 is going to be created. [ 674.203832] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.205739] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.205739] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.206249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.206835] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.227037] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6440e2db-5336-4fd7-b450-468fa8f78560 in Status: UNINITIALIZED for 2s [ 674.312416] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-156af133-c5cb-4af5-87be-b21d4422308a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.312594] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.312662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.312881] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.313056] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.313223] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.313324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.313482] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.313564] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.313650] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.313838] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-156af133-c5cb-4af5-87be-b21d4422308a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.313893] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.313952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.314107] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.314278] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.314420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.314500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.314715] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.314808] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.314877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.315020] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('156af133-c5cb-4af5-87be-b21d4422308a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.330530] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81eb9364-69c4-4e1a-b312-f1042ae807e2 [ 674.330875] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.332388] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.332388] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.332388] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.332388] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.332388] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81eb9364-69c4-4e1a-b312-f1042ae807e2 already deleted. [ 674.332388] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81eb9364-69c4-4e1a-b312-f1042ae807e2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.525666] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c098d26-24c9-45c9-86ed-e22e77625917 [ 674.525666] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.525666] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.525666] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.528205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.528205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.528205] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c098d26-24c9-45c9-86ed-e22e77625917 already deleted. [ 674.528205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c098d26-24c9-45c9-86ed-e22e77625917" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.672989] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.672989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.672989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.672989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.672989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.672989] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.672989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.672989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.672989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.672989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.672989] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 already deleted. [ 674.672989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.724963] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-28 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.725184] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-28" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.725467] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-28" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.725666] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-28" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.725944] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.726679] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.726833] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.730019] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.730019] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.730019] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 674.730019] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 674.730019] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 674.730019] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 674.730019] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 674.730019] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 674.730019] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 674.753962] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 674.754242] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 674.754448] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 674.754689] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-28" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.755035] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-b112a351-376b-4433-94a9-e8e186f3dff3 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.755218] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-b112a351-376b-4433-94a9-e8e186f3dff3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.755338] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-b112a351-376b-4433-94a9-e8e186f3dff3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.757838] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-b112a351-376b-4433-94a9-e8e186f3dff3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.758034] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b112a351-376b-4433-94a9-e8e186f3dff3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.818195] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 156af133-c5cb-4af5-87be-b21d4422308a: rpc.has_security_group_logging(os_id): False [ 674.841389] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.841653] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.841749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.841990] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.842146] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.842553] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.842553] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.842684] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.842776] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.842945] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.843147] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.843600] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.843600] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.843600] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.843600] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.844153] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.844153] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.844153] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.845627] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.845627] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.845627] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 156af133-c5cb-4af5-87be-b21d4422308a is going to be created. [ 674.930171] env[69920]: INFO networking_nsxv3.common.synchronization [None req-c68ca293-d976-46d5-8541-814a1f3631b9 None None] Enqueued Resource ID: c3253c37-ce07-4c79-8249-e43c0d836e20 with Priority: HIGHEST for action port [ 674.931924] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.932393] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.932826] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.933519] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.933972] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.936069] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3253c37-ce07-4c79-8249-e43c0d836e20 with Priority: HIGHEST for action port [ 674.936703] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3253c37-ce07-4c79-8249-e43c0d836e20 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.937025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3253c37-ce07-4c79-8249-e43c0d836e20" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.937228] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3253c37-ce07-4c79-8249-e43c0d836e20" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.937756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3253c37-ce07-4c79-8249-e43c0d836e20" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.937955] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3253c37-ce07-4c79-8249-e43c0d836e20',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.952259] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 156af133-c5cb-4af5-87be-b21d4422308a in Status: IN_PROGRESS for 2s [ 675.260245] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.260548] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.260852] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.261428] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.261802] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.262048] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port b112a351-376b-4433-94a9-e8e186f3dff3 not found, creating... [ 675.262475] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.262727] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.262861] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.263219] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.263626] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.264435] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.264835] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.265184] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.265605] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.266080] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.266316] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: b112a351-376b-4433-94a9-e8e186f3dff3 is going to be created. [ 675.289579] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.289579] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.289579] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.289579] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.292067] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.292410] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-b112a351-376b-4433-94a9-e8e186f3dff3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.445536] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c3253c37-ce07-4c79-8249-e43c0d836e20 [ 675.445536] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.445536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.445536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.445536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.445536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.445536] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c3253c37-ce07-4c79-8249-e43c0d836e20 already deleted. [ 675.445536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3253c37-ce07-4c79-8249-e43c0d836e20" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.752056] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc in Status: SUCCESS [ 675.752656] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.242324] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6440e2db-5336-4fd7-b450-468fa8f78560 in Status: SUCCESS [ 676.242324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.242324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.242324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.242324] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.242324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.242324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.242324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.242324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.242324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.242324] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6440e2db-5336-4fd7-b450-468fa8f78560',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.356626] env[69920]: INFO networking_nsxv3.common.synchronization [req-195fe0ef-e0de-44b1-97c7-14f3f1626442 req-4df48542-c8a1-461d-8ceb-dfe45943765f service nova] Enqueued Resource ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 with Priority: HIGHEST for action security_group_rules [ 676.356957] env[69920]: INFO networking_nsxv3.common.synchronization [req-195fe0ef-e0de-44b1-97c7-14f3f1626442 req-4df48542-c8a1-461d-8ceb-dfe45943765f service nova] Enqueued Resource ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 with Priority: HIGHEST for action security_group_members [ 676.356957] env[69920]: INFO networking_nsxv3.common.synchronization [req-195fe0ef-e0de-44b1-97c7-14f3f1626442 req-4df48542-c8a1-461d-8ceb-dfe45943765f service nova] Enqueued Resource ID: b112a351-376b-4433-94a9-e8e186f3dff3 with Priority: HIGHEST for action port [ 676.357502] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 with Priority: HIGHEST for action security_group_rules [ 676.357633] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 with Priority: HIGHEST for action security_group_members [ 676.357724] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b112a351-376b-4433-94a9-e8e186f3dff3 with Priority: HIGHEST for action port [ 676.360361] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e86ba42-7c29-4732-915b-33713b63d0b7 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.360430] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.360513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.360849] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.360849] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e86ba42-7c29-4732-915b-33713b63d0b7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.361885] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e86ba42-7c29-4732-915b-33713b63d0b7 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.362081] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.362137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.362329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.362499] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.362601] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.362661] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.363795] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.363795] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.363795] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e86ba42-7c29-4732-915b-33713b63d0b7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.365078] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-b112a351-376b-4433-94a9-e8e186f3dff3 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.365188] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b112a351-376b-4433-94a9-e8e186f3dff3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.365252] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b112a351-376b-4433-94a9-e8e186f3dff3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.365453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b112a351-376b-4433-94a9-e8e186f3dff3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.365510] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b112a351-376b-4433-94a9-e8e186f3dff3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.491371] env[69920]: INFO networking_nsxv3.common.synchronization [None req-3ae2fa4f-bed5-4415-9f8c-ec8372166a10 tempest-ServersTestManualDisk-1798148514 tempest-ServersTestManualDisk-1798148514-project-member] Enqueued Resource ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 with Priority: HIGHEST for action security_group_rules [ 676.491371] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 with Priority: HIGHEST for action security_group_rules [ 676.491371] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e5cbff-80b3-432a-81ac-0bf4249c4679 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.491371] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.491371] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.491834] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.492059] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e5cbff-80b3-432a-81ac-0bf4249c4679',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.646131] env[69920]: INFO networking_nsxv3.common.synchronization [None req-5801e563-a108-415d-acbd-bacf9be7e1d0 tempest-ServersTestManualDisk-1798148514 tempest-ServersTestManualDisk-1798148514-project-member] Enqueued Resource ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 with Priority: HIGHEST for action security_group_rules [ 676.646483] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 with Priority: HIGHEST for action security_group_rules [ 676.646906] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e5cbff-80b3-432a-81ac-0bf4249c4679 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.647071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.751459] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6440e2db-5336-4fd7-b450-468fa8f78560 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.751559] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.751559] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.751776] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.751914] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.752023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.752087] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.752248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.752446] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.752446] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.752906] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6440e2db-5336-4fd7-b450-468fa8f78560 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.752906] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.752906] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.752906] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.753354] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.753354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.753354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.753354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.753550] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.753550] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.753632] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6440e2db-5336-4fd7-b450-468fa8f78560',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.871374] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e86ba42-7c29-4732-915b-33713b63d0b7 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.871374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.871374] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b112a351-376b-4433-94a9-e8e186f3dff3 with status ACTIVE [ 676.871374] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.871374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.871374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.871374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.871374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.871374] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.871374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.871374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.871374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.871374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.871374] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.871899] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.871899] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.871899] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.871899] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.871899] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b112a351-376b-4433-94a9-e8e186f3dff3 is going to be updated. [ 676.872916] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e86ba42-7c29-4732-915b-33713b63d0b7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.897821] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.897821] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.897821] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.897821] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.898087] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.898199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b112a351-376b-4433-94a9-e8e186f3dff3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.969986] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 156af133-c5cb-4af5-87be-b21d4422308a in Status: SUCCESS [ 676.971148] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.027179] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.027359] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.027434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.027689] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.027827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.027963] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 already deleted. [ 677.028328] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.028367] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.028600] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.028653] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e5cbff-80b3-432a-81ac-0bf4249c4679',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.255741] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6440e2db-5336-4fd7-b450-468fa8f78560: rpc.has_security_group_logging(os_id): False [ 677.281486] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.281486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.281486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.281659] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.281736] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.283723] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.283723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.283723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.283723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.283723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.283723] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.283723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.283723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.283723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.283723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.283723] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.283723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.283723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.284460] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.284460] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.284460] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6440e2db-5336-4fd7-b450-468fa8f78560 is going to be created. [ 677.355855] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.356229] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.356718] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.357186] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.357461] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.371480] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6440e2db-5336-4fd7-b450-468fa8f78560 in Status: IN_PROGRESS for 2s [ 677.375943] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e86ba42-7c29-4732-915b-33713b63d0b7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.459449] env[69920]: INFO networking_nsxv3.common.synchronization [None req-a7bd45d2-c4db-4de9-9906-3d66db107ea3 None None] Enqueued Resource ID: a067f22f-6d6e-4aec-beae-22da66839fbf with Priority: HIGHEST for action port [ 677.459449] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a067f22f-6d6e-4aec-beae-22da66839fbf with Priority: HIGHEST for action port [ 677.459449] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-a067f22f-6d6e-4aec-beae-22da66839fbf taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.460051] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a067f22f-6d6e-4aec-beae-22da66839fbf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.460051] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a067f22f-6d6e-4aec-beae-22da66839fbf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.460731] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a067f22f-6d6e-4aec-beae-22da66839fbf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.460780] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a067f22f-6d6e-4aec-beae-22da66839fbf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.556066] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.556066] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.556066] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.556066] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.556066] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.556066] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 already deleted. [ 677.556066] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.878740] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.878740] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.878740] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.879116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.879116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.879116] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 is going to be created. [ 677.906095] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.906538] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.906538] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.907193] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.907193] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.917804] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 in Status: UNINITIALIZED for 2s [ 677.967587] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a067f22f-6d6e-4aec-beae-22da66839fbf [ 677.970048] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.970048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.970048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.970048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.970048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.970048] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a067f22f-6d6e-4aec-beae-22da66839fbf already deleted. [ 677.970048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a067f22f-6d6e-4aec-beae-22da66839fbf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.385315] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6440e2db-5336-4fd7-b450-468fa8f78560 in Status: SUCCESS [ 679.385585] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.930100] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 in Status: SUCCESS [ 679.930100] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.930100] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.930638] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.930638] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.930638] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.930638] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.933723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.933723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.933723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.933723] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e86ba42-7c29-4732-915b-33713b63d0b7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.198636] env[69920]: INFO networking_nsxv3.common.synchronization [None req-11d91423-d283-44d9-99da-677764dc1b3f None None] Enqueued Resource ID: df2db87c-85c4-4c24-a39d-c5e80bec6005 with Priority: HIGHEST for action port [ 680.199298] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df2db87c-85c4-4c24-a39d-c5e80bec6005 with Priority: HIGHEST for action port [ 680.199641] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-df2db87c-85c4-4c24-a39d-c5e80bec6005 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.199816] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df2db87c-85c4-4c24-a39d-c5e80bec6005" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.199931] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df2db87c-85c4-4c24-a39d-c5e80bec6005" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.200270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df2db87c-85c4-4c24-a39d-c5e80bec6005" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.200367] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df2db87c-85c4-4c24-a39d-c5e80bec6005',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.436981] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e86ba42-7c29-4732-915b-33713b63d0b7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.611727] env[69920]: INFO networking_nsxv3.common.synchronization [req-b28916e0-198e-4d85-91b9-0b08e633cee8 req-ca8feb29-9c76-4344-9694-c4c5a4046d4d tempest-ServerDiagnosticsNegativeTest-1566978478 tempest-ServerDiagnosticsNegativeTest-1566978478-project-member] Enqueued Resource ID: 667ad5b8-40a7-4438-a71d-51999e9b972e with Priority: HIGHEST for action security_group_members [ 680.612600] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 667ad5b8-40a7-4438-a71d-51999e9b972e with Priority: HIGHEST for action security_group_members [ 680.612925] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-667ad5b8-40a7-4438-a71d-51999e9b972e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.613070] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.613140] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.613361] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.613522] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.613659] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.613659] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.613844] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.613895] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.613964] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('667ad5b8-40a7-4438-a71d-51999e9b972e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.704202] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df2db87c-85c4-4c24-a39d-c5e80bec6005 [ 680.704202] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.704202] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.704202] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.704202] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.704202] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.704202] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df2db87c-85c4-4c24-a39d-c5e80bec6005 already deleted. [ 680.704202] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df2db87c-85c4-4c24-a39d-c5e80bec6005" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.941508] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e86ba42-7c29-4732-915b-33713b63d0b7: rpc.has_security_group_logging(os_id): False [ 680.965251] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.965448] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.966540] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.967100] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.967334] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.968259] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.968523] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.968523] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.968781] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.968870] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.968986] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 is going to be created. [ 681.046416] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.046573] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.046642] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.057373] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.057373] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.068670] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 in Status: IN_PROGRESS for 2s [ 681.117090] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.117290] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.117370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.118773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.118920] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.119184] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.119302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.119367] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.119589] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.119668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.120602] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 667ad5b8-40a7-4438-a71d-51999e9b972e is going to be updated. [ 681.211504] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.211739] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.212947] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.214226] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.214442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.229271] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 667ad5b8-40a7-4438-a71d-51999e9b972e in Status: IN_PROGRESS for 2s [ 681.654452] env[69920]: INFO networking_nsxv3.common.synchronization [req-288ff329-245e-4962-a8fe-09a35a53bec8 req-c6aa4d03-95ad-4463-bc16-a89e1eb1bebe tempest-ListServersNegativeTestJSON-2142759027 tempest-ListServersNegativeTestJSON-2142759027-project-member] Enqueued Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_members [ 681.655557] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_members [ 681.656437] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4fb140-8d8f-45fe-9d42-7405286ea87b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.656580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.656653] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.657250] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.657677] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.657837] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.657910] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.658137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.662028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.662028] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.161965] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.162192] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.162290] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.162524] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.162616] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.162816] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.162918] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.162992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.163141] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.163319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.163438] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b already deleted. [ 682.163531] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.474628] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-865 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.474828] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-865" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.474970] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-865" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.475828] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-865" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.476156] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.476331] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.476454] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.476691] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.476840] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.477332] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.477458] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.477591] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.477922] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.478310] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 682.478416] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.478562] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.498141] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.498326] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 682.498447] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.498633] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-865" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.498955] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-6c93c813-14c8-4f76-918b-6efb59510588 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.499140] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-6c93c813-14c8-4f76-918b-6efb59510588" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.499262] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-6c93c813-14c8-4f76-918b-6efb59510588" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.499594] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-6c93c813-14c8-4f76-918b-6efb59510588" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.499735] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c93c813-14c8-4f76-918b-6efb59510588',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.570114] env[69920]: INFO networking_nsxv3.common.synchronization [None req-613aaea5-c55f-415f-9593-c364d4f7169d None None] Enqueued Resource ID: 8a178ccf-1c57-4489-a68a-243585347035 with Priority: HIGHEST for action port [ 682.573101] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a178ccf-1c57-4489-a68a-243585347035 with Priority: HIGHEST for action port [ 682.573101] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a178ccf-1c57-4489-a68a-243585347035 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.573101] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a178ccf-1c57-4489-a68a-243585347035" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.573101] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a178ccf-1c57-4489-a68a-243585347035" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.573101] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a178ccf-1c57-4489-a68a-243585347035" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.573101] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a178ccf-1c57-4489-a68a-243585347035',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.008033] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.008033] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.008033] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.008033] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.008033] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.008033] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 6c93c813-14c8-4f76-918b-6efb59510588 not found, creating... [ 683.008033] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.008033] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.008033] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.008033] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.008033] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.008730] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.008730] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.008730] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.008730] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.008730] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.010990] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 6c93c813-14c8-4f76-918b-6efb59510588 is going to be created. [ 683.040919] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.040919] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.040919] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.040919] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.040919] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.040919] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-6c93c813-14c8-4f76-918b-6efb59510588" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.073305] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a178ccf-1c57-4489-a68a-243585347035 [ 683.075533] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.075533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.075533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.075533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.075533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.075533] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a178ccf-1c57-4489-a68a-243585347035 already deleted. [ 683.075533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a178ccf-1c57-4489-a68a-243585347035" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.083926] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 in Status: SUCCESS [ 683.083926] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.240933] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 667ad5b8-40a7-4438-a71d-51999e9b972e in Status: SUCCESS [ 683.241236] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 667ad5b8-40a7-4438-a71d-51999e9b972e deletion is rescheduled due to dependency. [ 683.241396] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.456791] env[69920]: INFO networking_nsxv3.common.synchronization [None req-f2208443-91b3-4137-b146-836ef9adae9e None None] Enqueued Resource ID: 206c7f6c-9e8e-43ec-b981-2d667476a384 with Priority: HIGHEST for action port [ 683.457060] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 206c7f6c-9e8e-43ec-b981-2d667476a384 with Priority: HIGHEST for action port [ 683.457646] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-206c7f6c-9e8e-43ec-b981-2d667476a384 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.457772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-206c7f6c-9e8e-43ec-b981-2d667476a384" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.457830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-206c7f6c-9e8e-43ec-b981-2d667476a384" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.459270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-206c7f6c-9e8e-43ec-b981-2d667476a384" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.459360] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('206c7f6c-9e8e-43ec-b981-2d667476a384',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.544595] env[69920]: INFO networking_nsxv3.common.synchronization [req-288ff329-245e-4962-a8fe-09a35a53bec8 req-ad58aabe-cbd8-44c3-83eb-47953b775d38 tempest-ListServersNegativeTestJSON-2142759027 tempest-ListServersNegativeTestJSON-2142759027-project-member] Enqueued Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_members [ 683.545520] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_members [ 683.545632] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4fb140-8d8f-45fe-9d42-7405286ea87b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.545822] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.545822] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.546019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.547876] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.548053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.548121] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.549599] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.549693] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.550237] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.915058] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-865 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.915058] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-865" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.915201] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-865" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.915385] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-865" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.915599] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.915799] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.916104] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.918244] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.918244] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.918323] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 683.918486] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 683.918723] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 683.918824] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 683.918934] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 683.919757] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 683.919757] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 683.942913] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 683.943020] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 683.943833] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 683.943833] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-865" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.943833] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-50ea3bc5-fa5d-49db-99d9-e842cb85c0d8 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.944043] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-50ea3bc5-fa5d-49db-99d9-e842cb85c0d8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.944043] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-50ea3bc5-fa5d-49db-99d9-e842cb85c0d8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.944573] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-50ea3bc5-fa5d-49db-99d9-e842cb85c0d8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.944573] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50ea3bc5-fa5d-49db-99d9-e842cb85c0d8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.963456] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 206c7f6c-9e8e-43ec-b981-2d667476a384 [ 683.965420] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.965420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.965420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.965420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.965420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.965420] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:206c7f6c-9e8e-43ec-b981-2d667476a384 already deleted. [ 683.965420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-206c7f6c-9e8e-43ec-b981-2d667476a384" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.054855] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.054855] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.054855] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.055193] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.055193] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.055508] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.055639] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.055721] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.056142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.056200] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.056284] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b already deleted. [ 684.060018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.378142] env[69920]: INFO networking_nsxv3.common.synchronization [None req-b7cdcbd3-1887-4968-8fe2-2a9f8e950272 None None] Enqueued Resource ID: d775f5fe-85ac-4ae4-b725-25d9b8a0fa1d with Priority: HIGHEST for action port [ 684.378142] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d775f5fe-85ac-4ae4-b725-25d9b8a0fa1d with Priority: HIGHEST for action port [ 684.378361] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-d775f5fe-85ac-4ae4-b725-25d9b8a0fa1d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.378361] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d775f5fe-85ac-4ae4-b725-25d9b8a0fa1d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.378361] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d775f5fe-85ac-4ae4-b725-25d9b8a0fa1d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.378573] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d775f5fe-85ac-4ae4-b725-25d9b8a0fa1d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.378652] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d775f5fe-85ac-4ae4-b725-25d9b8a0fa1d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.448980] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.449228] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.449358] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.449648] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.449801] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.449956] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 50ea3bc5-fa5d-49db-99d9-e842cb85c0d8 not found, creating... [ 684.450232] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.450404] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.450517] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.450768] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.450910] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.451218] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.451378] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.451498] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.451712] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.451848] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.451989] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 50ea3bc5-fa5d-49db-99d9-e842cb85c0d8 is going to be created. [ 684.475985] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.476456] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.476699] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.477081] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.477417] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.477958] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-50ea3bc5-fa5d-49db-99d9-e842cb85c0d8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.882054] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d775f5fe-85ac-4ae4-b725-25d9b8a0fa1d [ 684.882434] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.882663] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.882785] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.883139] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.883359] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.883518] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d775f5fe-85ac-4ae4-b725-25d9b8a0fa1d already deleted. [ 684.883685] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d775f5fe-85ac-4ae4-b725-25d9b8a0fa1d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.410411] env[69920]: INFO networking_nsxv3.common.synchronization [req-288ff329-245e-4962-a8fe-09a35a53bec8 req-2ec07ea5-e3a3-48c3-abd0-a2676b988efd service nova] Enqueued Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_rules [ 685.410655] env[69920]: INFO networking_nsxv3.common.synchronization [req-288ff329-245e-4962-a8fe-09a35a53bec8 req-2ec07ea5-e3a3-48c3-abd0-a2676b988efd service nova] Enqueued Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_members [ 685.410786] env[69920]: INFO networking_nsxv3.common.synchronization [req-288ff329-245e-4962-a8fe-09a35a53bec8 req-2ec07ea5-e3a3-48c3-abd0-a2676b988efd service nova] Enqueued Resource ID: 6c93c813-14c8-4f76-918b-6efb59510588 with Priority: HIGHEST for action port [ 685.411773] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_rules [ 685.411921] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_members [ 685.413063] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c93c813-14c8-4f76-918b-6efb59510588 with Priority: HIGHEST for action port [ 685.413861] env[69920]: INFO networking_nsxv3.common.synchronization [req-288ff329-245e-4962-a8fe-09a35a53bec8 req-732cc8b0-64a5-4144-9956-ef46c8123179 service nova] Enqueued Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_rules [ 685.414072] env[69920]: INFO networking_nsxv3.common.synchronization [req-288ff329-245e-4962-a8fe-09a35a53bec8 req-732cc8b0-64a5-4144-9956-ef46c8123179 service nova] Enqueued Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_members [ 685.414266] env[69920]: INFO networking_nsxv3.common.synchronization [req-288ff329-245e-4962-a8fe-09a35a53bec8 req-732cc8b0-64a5-4144-9956-ef46c8123179 service nova] Enqueued Resource ID: 50ea3bc5-fa5d-49db-99d9-e842cb85c0d8 with Priority: HIGHEST for action port [ 685.414634] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b4fb140-8d8f-45fe-9d42-7405286ea87b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.414710] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.414773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.415137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.415256] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.416153] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4fb140-8d8f-45fe-9d42-7405286ea87b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.416291] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.416357] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.418377] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.420054] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.420054] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.420054] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.420054] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.420054] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.420054] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.420798] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c93c813-14c8-4f76-918b-6efb59510588 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.420918] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c93c813-14c8-4f76-918b-6efb59510588" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.420958] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c93c813-14c8-4f76-918b-6efb59510588" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.421144] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c93c813-14c8-4f76-918b-6efb59510588" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.421219] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c93c813-14c8-4f76-918b-6efb59510588',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.424424] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_rules [ 685.424424] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_members [ 685.424424] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50ea3bc5-fa5d-49db-99d9-e842cb85c0d8 with Priority: HIGHEST for action port [ 685.424424] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b4fb140-8d8f-45fe-9d42-7405286ea87b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.424424] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.424959] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4fb140-8d8f-45fe-9d42-7405286ea87b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.424959] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.424959] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-50ea3bc5-fa5d-49db-99d9-e842cb85c0d8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.424959] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50ea3bc5-fa5d-49db-99d9-e842cb85c0d8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.424959] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50ea3bc5-fa5d-49db-99d9-e842cb85c0d8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.425238] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50ea3bc5-fa5d-49db-99d9-e842cb85c0d8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.425238] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50ea3bc5-fa5d-49db-99d9-e842cb85c0d8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.794329] env[69920]: INFO networking_nsxv3.common.synchronization [req-55d53a20-fb27-461e-8adb-b533a80f89d6 req-2749cebb-ceab-40be-a7bc-0e3f262f9686 tempest-DeleteServersAdminTestJSON-1423119463 tempest-DeleteServersAdminTestJSON-1423119463-project-admin] Enqueued Resource ID: c27221ee-5342-4aa7-83da-a28291a2021a with Priority: HIGHEST for action security_group_members [ 685.794638] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27221ee-5342-4aa7-83da-a28291a2021a with Priority: HIGHEST for action security_group_members [ 685.795222] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27221ee-5342-4aa7-83da-a28291a2021a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.795354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.795420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.795692] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.795866] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.795977] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.796052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.796218] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.796308] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.796403] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c27221ee-5342-4aa7-83da-a28291a2021a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.925325] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.925846] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4fb140-8d8f-45fe-9d42-7405286ea87b taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.925951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.929331] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c93c813-14c8-4f76-918b-6efb59510588 with status ACTIVE [ 685.929544] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.929676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.929747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.929986] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.930076] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.930291] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.930422] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.930422] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.930583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.930668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.930851] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.930947] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.931021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.931173] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.931459] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.931459] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c93c813-14c8-4f76-918b-6efb59510588 is going to be updated. [ 685.933193] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 50ea3bc5-fa5d-49db-99d9-e842cb85c0d8 with status ACTIVE [ 685.933880] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.934035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.934268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.934691] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.934793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.934990] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.935113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.935271] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.935375] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.935460] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.935841] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.936582] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.936688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.936900] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.936988] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.937092] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 50ea3bc5-fa5d-49db-99d9-e842cb85c0d8 is going to be updated. [ 685.970453] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.970453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.970453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.970453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.970453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.970453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c93c813-14c8-4f76-918b-6efb59510588" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.970453] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.970453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.970453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.970453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.970453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.971528] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50ea3bc5-fa5d-49db-99d9-e842cb85c0d8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.299585] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.299585] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.299585] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.299812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.299812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.300016] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.300124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.300188] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.300338] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.300587] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.300587] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c27221ee-5342-4aa7-83da-a28291a2021a is going to be updated. [ 686.334206] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.334206] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.334206] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.334206] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.334206] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.343526] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27221ee-5342-4aa7-83da-a28291a2021a in Status: IN_PROGRESS for 2s [ 686.429527] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.509835] env[69920]: INFO networking_nsxv3.common.synchronization [None req-b98614cd-ca89-4d76-b1f4-f8c1fb356c66 None None] Enqueued Resource ID: 3234a7ed-67d7-47f8-a083-700df5c365d7 with Priority: HIGHEST for action port [ 686.510060] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3234a7ed-67d7-47f8-a083-700df5c365d7 with Priority: HIGHEST for action port [ 686.510638] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-3234a7ed-67d7-47f8-a083-700df5c365d7 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.510762] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3234a7ed-67d7-47f8-a083-700df5c365d7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.514681] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3234a7ed-67d7-47f8-a083-700df5c365d7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.515191] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3234a7ed-67d7-47f8-a083-700df5c365d7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.515332] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3234a7ed-67d7-47f8-a083-700df5c365d7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.541833] env[69920]: INFO networking_nsxv3.common.synchronization [req-66ef7af8-202a-45b6-9ea7-fa3702297090 req-74877bc4-42cc-4191-84ae-e8347c9a7cc3 tempest-ImagesNegativeTestJSON-1748246780 tempest-ImagesNegativeTestJSON-1748246780-project-member] Enqueued Resource ID: 5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc with Priority: HIGHEST for action security_group_members [ 686.542391] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc with Priority: HIGHEST for action security_group_members [ 686.542656] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.542744] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.542790] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.543834] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.544038] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.544180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.544325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.544508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.544595] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.544714] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.578279] env[69920]: INFO networking_nsxv3.common.synchronization [None req-ee4a6f5a-e656-4b6e-a715-c2f373b727a9 None None] Enqueued Resource ID: 92bd5efa-1c62-45e4-a15a-88b551ea50c6 with Priority: HIGHEST for action port [ 686.578762] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92bd5efa-1c62-45e4-a15a-88b551ea50c6 with Priority: HIGHEST for action port [ 686.579102] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-92bd5efa-1c62-45e4-a15a-88b551ea50c6 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.579225] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92bd5efa-1c62-45e4-a15a-88b551ea50c6" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.579288] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92bd5efa-1c62-45e4-a15a-88b551ea50c6" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.579545] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92bd5efa-1c62-45e4-a15a-88b551ea50c6" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.579616] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92bd5efa-1c62-45e4-a15a-88b551ea50c6',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.932715] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.932961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.933085] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.933378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.933480] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.933617] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b is going to be created. [ 686.963103] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.963103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.963103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.963103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.963413] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.973396] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b in Status: UNINITIALIZED for 2s [ 687.018370] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3234a7ed-67d7-47f8-a083-700df5c365d7 [ 687.018604] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.018746] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.018826] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.019146] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.019244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.019355] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3234a7ed-67d7-47f8-a083-700df5c365d7 already deleted. [ 687.019484] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3234a7ed-67d7-47f8-a083-700df5c365d7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.049656] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.049730] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.049795] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.050035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.050139] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.050335] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.050435] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.050499] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.050651] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.050730] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.050818] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc is going to be updated. [ 687.062928] env[69920]: INFO networking_nsxv3.common.synchronization [req-288ff329-245e-4962-a8fe-09a35a53bec8 req-368d6ee9-fd20-40b9-ae9e-4adc4e4003c5 tempest-ListServersNegativeTestJSON-2142759027 tempest-ListServersNegativeTestJSON-2142759027-project-member] Enqueued Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_members [ 687.064909] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_members [ 687.064909] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4fb140-8d8f-45fe-9d42-7405286ea87b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.064909] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.078706] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.078706] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.078862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.078954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.080166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.084484] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92bd5efa-1c62-45e4-a15a-88b551ea50c6 [ 687.084790] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.084790] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.084790] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.084945] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.084994] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.085100] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92bd5efa-1c62-45e4-a15a-88b551ea50c6 already deleted. [ 687.085189] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92bd5efa-1c62-45e4-a15a-88b551ea50c6" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.088982] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc in Status: IN_PROGRESS for 2s [ 688.018641] env[69920]: INFO networking_nsxv3.common.synchronization [None req-819cde94-07d1-40d2-929e-989ffbbd8f64 None None] Enqueued Resource ID: 851b0e38-12de-446e-ad11-99d0b56166c8 with Priority: HIGHEST for action port [ 688.018939] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 851b0e38-12de-446e-ad11-99d0b56166c8 with Priority: HIGHEST for action port [ 688.019633] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-851b0e38-12de-446e-ad11-99d0b56166c8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.019837] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-851b0e38-12de-446e-ad11-99d0b56166c8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.019885] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-851b0e38-12de-446e-ad11-99d0b56166c8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.022101] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-851b0e38-12de-446e-ad11-99d0b56166c8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.022101] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('851b0e38-12de-446e-ad11-99d0b56166c8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.174859] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-865 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.174859] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-865" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.174859] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-865" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.176964] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-865" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.177844] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.178249] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.178790] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.180588] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.180588] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.180588] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 688.180588] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 688.180588] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 688.180588] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 688.180588] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 688.180588] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 688.180588] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 688.226906] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 688.227467] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.047 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 688.227467] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 688.227467] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-865" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.227714] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-5aeee040-2531-4d68-871a-2f65a93ad448 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.227928] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-5aeee040-2531-4d68-871a-2f65a93ad448" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.228069] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-5aeee040-2531-4d68-871a-2f65a93ad448" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.228424] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-5aeee040-2531-4d68-871a-2f65a93ad448" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.228562] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5aeee040-2531-4d68-871a-2f65a93ad448',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.357264] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27221ee-5342-4aa7-83da-a28291a2021a in Status: SUCCESS [ 688.357486] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c27221ee-5342-4aa7-83da-a28291a2021a deletion is rescheduled due to dependency. [ 688.357673] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.524822] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 851b0e38-12de-446e-ad11-99d0b56166c8 [ 688.527234] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.527234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.527234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.527234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.527234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.527234] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:851b0e38-12de-446e-ad11-99d0b56166c8 already deleted. [ 688.527234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-851b0e38-12de-446e-ad11-99d0b56166c8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.732523] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.733813] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.733813] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.735973] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.736162] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.736364] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 5aeee040-2531-4d68-871a-2f65a93ad448 not found, creating... [ 688.738233] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.738233] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.738233] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.738233] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.738233] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.738233] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.738233] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.738233] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.738732] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.738732] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.738732] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 5aeee040-2531-4d68-871a-2f65a93ad448 is going to be created. [ 688.762228] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.762433] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.764484] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.764484] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.764484] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.764484] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-5aeee040-2531-4d68-871a-2f65a93ad448" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.777667] env[69920]: INFO networking_nsxv3.common.synchronization [req-1148cd85-0485-454f-a3f3-aa152d757056 req-40b62afa-771c-49a2-963b-e03be900e91c tempest-ServerDiagnosticsTest-2111870055 tempest-ServerDiagnosticsTest-2111870055-project-member] Enqueued Resource ID: 8772ae4d-b3d8-4986-b291-e37049ac05b0 with Priority: HIGHEST for action security_group_members [ 688.777667] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8772ae4d-b3d8-4986-b291-e37049ac05b0 with Priority: HIGHEST for action security_group_members [ 688.777667] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8772ae4d-b3d8-4986-b291-e37049ac05b0 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.777667] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.777667] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.777667] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.777667] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.777667] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.778230] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.778230] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.778230] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.778321] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8772ae4d-b3d8-4986-b291-e37049ac05b0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.986002] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b in Status: SUCCESS [ 688.986213] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.986325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.986654] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.986840] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.986922] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.986922] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.987128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.987211] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.987309] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.106773] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc in Status: SUCCESS [ 689.106773] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc deletion is rescheduled due to dependency. [ 689.106773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.280431] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.280431] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.280621] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.280697] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.282437] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.282437] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.282604] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.282604] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.282956] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.282956] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.282956] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8772ae4d-b3d8-4986-b291-e37049ac05b0 already deleted. [ 689.283097] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.373324] env[69920]: INFO networking_nsxv3.common.synchronization [None req-2532e906-b8cb-4598-8068-516996c86e16 None None] Enqueued Resource ID: 50177174-88e2-4844-b1f2-ba8ff11c772a with Priority: HIGHEST for action port [ 689.373324] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50177174-88e2-4844-b1f2-ba8ff11c772a with Priority: HIGHEST for action port [ 689.378532] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-50177174-88e2-4844-b1f2-ba8ff11c772a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.378532] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50177174-88e2-4844-b1f2-ba8ff11c772a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.378532] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50177174-88e2-4844-b1f2-ba8ff11c772a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.378532] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50177174-88e2-4844-b1f2-ba8ff11c772a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.378532] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50177174-88e2-4844-b1f2-ba8ff11c772a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.491657] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.880737] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50177174-88e2-4844-b1f2-ba8ff11c772a [ 689.880964] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.881122] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.881202] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.881448] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.881543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.881653] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50177174-88e2-4844-b1f2-ba8ff11c772a already deleted. [ 689.881783] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50177174-88e2-4844-b1f2-ba8ff11c772a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.962761] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-207 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.962761] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.962761] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.962761] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.962761] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.963409] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.964767] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.965080] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.967329] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.967658] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 689.967814] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 689.967960] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 689.968126] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 689.968311] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 689.968402] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 689.968554] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 689.990274] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 689.990433] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 689.990579] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 689.990810] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.991275] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-34f427e8-f150-431f-960f-584ea344457c taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.991516] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-34f427e8-f150-431f-960f-584ea344457c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.991642] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-34f427e8-f150-431f-960f-584ea344457c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.991973] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-34f427e8-f150-431f-960f-584ea344457c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.992175] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34f427e8-f150-431f-960f-584ea344457c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.994567] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.183443] env[69920]: INFO networking_nsxv3.common.synchronization [None req-330c6ba6-211c-4fa7-8f94-6783d1975cc7 None None] Enqueued Resource ID: 0bddbced-b266-4284-8ab8-1f1620cad3f2 with Priority: HIGHEST for action port [ 690.184175] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bddbced-b266-4284-8ab8-1f1620cad3f2 with Priority: HIGHEST for action port [ 690.184573] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bddbced-b266-4284-8ab8-1f1620cad3f2 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.184747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bddbced-b266-4284-8ab8-1f1620cad3f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.184747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bddbced-b266-4284-8ab8-1f1620cad3f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.185148] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bddbced-b266-4284-8ab8-1f1620cad3f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.185233] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bddbced-b266-4284-8ab8-1f1620cad3f2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.235850] env[69920]: INFO networking_nsxv3.common.synchronization [None req-62bc8ee7-856c-4605-8401-6d8dce7b38c9 None None] Enqueued Resource ID: 22d34d22-28e4-427e-9b10-b0561ea7631d with Priority: HIGHEST for action port [ 690.235850] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22d34d22-28e4-427e-9b10-b0561ea7631d with Priority: HIGHEST for action port [ 690.235850] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-22d34d22-28e4-427e-9b10-b0561ea7631d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.235850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22d34d22-28e4-427e-9b10-b0561ea7631d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.235850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22d34d22-28e4-427e-9b10-b0561ea7631d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.235850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22d34d22-28e4-427e-9b10-b0561ea7631d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.235850] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22d34d22-28e4-427e-9b10-b0561ea7631d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.265101] env[69920]: INFO networking_nsxv3.common.synchronization [req-288ff329-245e-4962-a8fe-09a35a53bec8 req-86827a1a-1d10-47b4-bbf7-dfc7db9d7cc1 service nova] Enqueued Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_rules [ 690.265101] env[69920]: INFO networking_nsxv3.common.synchronization [req-288ff329-245e-4962-a8fe-09a35a53bec8 req-86827a1a-1d10-47b4-bbf7-dfc7db9d7cc1 service nova] Enqueued Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_members [ 690.265101] env[69920]: INFO networking_nsxv3.common.synchronization [req-288ff329-245e-4962-a8fe-09a35a53bec8 req-86827a1a-1d10-47b4-bbf7-dfc7db9d7cc1 service nova] Enqueued Resource ID: 5aeee040-2531-4d68-871a-2f65a93ad448 with Priority: HIGHEST for action port [ 690.265509] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_rules [ 690.265509] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_members [ 690.265584] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5aeee040-2531-4d68-871a-2f65a93ad448 with Priority: HIGHEST for action port [ 690.266155] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b4fb140-8d8f-45fe-9d42-7405286ea87b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.266275] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.266517] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4fb140-8d8f-45fe-9d42-7405286ea87b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.266572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.266734] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-5aeee040-2531-4d68-871a-2f65a93ad448 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.266830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5aeee040-2531-4d68-871a-2f65a93ad448" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.266895] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5aeee040-2531-4d68-871a-2f65a93ad448" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.267126] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5aeee040-2531-4d68-871a-2f65a93ad448" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.267208] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5aeee040-2531-4d68-871a-2f65a93ad448',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.495825] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.499308] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.499308] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.499308] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.499308] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.499308] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 34f427e8-f150-431f-960f-584ea344457c not found, creating... [ 690.499308] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.499308] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.499308] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.499308] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.499308] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.499989] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.500467] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.500879] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.501621] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.501908] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.502207] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 34f427e8-f150-431f-960f-584ea344457c is going to be created. [ 690.504766] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.504766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.505376] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.505515] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.507738] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.507738] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b is going to be updated. [ 690.535730] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.535982] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.536106] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.536671] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.536671] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.537079] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-34f427e8-f150-431f-960f-584ea344457c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.542136] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.542235] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.542235] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.542421] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.542554] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.554662] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b in Status: IN_PROGRESS for 2s [ 690.692397] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0bddbced-b266-4284-8ab8-1f1620cad3f2 [ 690.693640] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.693640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.693640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.693640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.693640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.693640] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0bddbced-b266-4284-8ab8-1f1620cad3f2 already deleted. [ 690.693640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bddbced-b266-4284-8ab8-1f1620cad3f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.739053] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 22d34d22-28e4-427e-9b10-b0561ea7631d [ 690.739053] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.739053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.739053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.739435] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.739435] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.739536] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:22d34d22-28e4-427e-9b10-b0561ea7631d already deleted. [ 690.739536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22d34d22-28e4-427e-9b10-b0561ea7631d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.770507] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5aeee040-2531-4d68-871a-2f65a93ad448 with status ACTIVE [ 690.770777] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.770918] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.770989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.771315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.771415] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.771521] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.771649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.771750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.771940] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.772046] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.772262] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.772371] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.772424] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.772616] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.772650] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.772760] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5aeee040-2531-4d68-871a-2f65a93ad448 is going to be updated. [ 690.804217] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.804373] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.804507] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.804681] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.804844] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.805411] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5aeee040-2531-4d68-871a-2f65a93ad448" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.782059] env[69920]: INFO networking_nsxv3.common.synchronization [None req-3058b022-c8e3-4545-b0cb-db37f622e59d tempest-AttachVolumeTestJSON-218421131 tempest-AttachVolumeTestJSON-218421131-project-member] Enqueued Resource ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 with Priority: HIGHEST for action security_group_rules [ 691.782613] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 with Priority: HIGHEST for action security_group_rules [ 691.782917] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a8bd4df-a8df-4d64-94ea-a00a62c48a01 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.783072] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.783137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.783431] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.783526] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a8bd4df-a8df-4d64-94ea-a00a62c48a01',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.823670] env[69920]: INFO networking_nsxv3.common.synchronization [req-72cf7643-f180-4065-8182-082f74461e7a req-6e13862c-2a03-40a4-9bc7-d04028ddb3af tempest-FloatingIPsAssociationNegativeTestJSON-1933372996 tempest-FloatingIPsAssociationNegativeTestJSON-1933372996-project-member] Enqueued Resource ID: f8b9ce1a-2b8e-4a65-b28c-620181c45204 with Priority: HIGHEST for action security_group_members [ 691.824411] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8b9ce1a-2b8e-4a65-b28c-620181c45204 with Priority: HIGHEST for action security_group_members [ 691.824749] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8b9ce1a-2b8e-4a65-b28c-620181c45204 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.824881] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.825847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.825847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.825847] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.825847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.825847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.825847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.825847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.826238] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8b9ce1a-2b8e-4a65-b28c-620181c45204',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.005341] env[69920]: INFO networking_nsxv3.common.synchronization [req-1148cd85-0485-454f-a3f3-aa152d757056 req-6938d595-944f-4d47-9927-4fead29db51f service nova] Enqueued Resource ID: 8772ae4d-b3d8-4986-b291-e37049ac05b0 with Priority: HIGHEST for action security_group_rules [ 692.005341] env[69920]: INFO networking_nsxv3.common.synchronization [req-1148cd85-0485-454f-a3f3-aa152d757056 req-6938d595-944f-4d47-9927-4fead29db51f service nova] Enqueued Resource ID: 8772ae4d-b3d8-4986-b291-e37049ac05b0 with Priority: HIGHEST for action security_group_members [ 692.005502] env[69920]: INFO networking_nsxv3.common.synchronization [req-1148cd85-0485-454f-a3f3-aa152d757056 req-6938d595-944f-4d47-9927-4fead29db51f service nova] Enqueued Resource ID: 34f427e8-f150-431f-960f-584ea344457c with Priority: HIGHEST for action port [ 692.005590] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8772ae4d-b3d8-4986-b291-e37049ac05b0 with Priority: HIGHEST for action security_group_rules [ 692.005911] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8772ae4d-b3d8-4986-b291-e37049ac05b0 with Priority: HIGHEST for action security_group_members [ 692.005911] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34f427e8-f150-431f-960f-584ea344457c with Priority: HIGHEST for action port [ 692.006643] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8772ae4d-b3d8-4986-b291-e37049ac05b0 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.006772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.006835] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.007159] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.007975] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8772ae4d-b3d8-4986-b291-e37049ac05b0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.008589] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8772ae4d-b3d8-4986-b291-e37049ac05b0 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.008686] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.008751] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.008954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.009131] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.009311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.009311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.009465] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.009862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.010501] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8772ae4d-b3d8-4986-b291-e37049ac05b0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.011348] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-34f427e8-f150-431f-960f-584ea344457c taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.011459] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34f427e8-f150-431f-960f-584ea344457c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.011513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34f427e8-f150-431f-960f-584ea344457c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.013757] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34f427e8-f150-431f-960f-584ea344457c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.013757] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34f427e8-f150-431f-960f-584ea344457c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.164118] env[69920]: INFO networking_nsxv3.common.synchronization [None req-375fdc43-e3c5-467f-a2df-229bb20072e7 tempest-AttachVolumeTestJSON-218421131 tempest-AttachVolumeTestJSON-218421131-project-member] Enqueued Resource ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 with Priority: HIGHEST for action security_group_rules [ 692.165761] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 with Priority: HIGHEST for action security_group_rules [ 692.166530] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a8bd4df-a8df-4d64-94ea-a00a62c48a01 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.166530] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.310064] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.310238] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.310911] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.310911] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.310911] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.310911] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 already deleted. [ 692.310911] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.311203] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.311203] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.311486] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a8bd4df-a8df-4d64-94ea-a00a62c48a01',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.328584] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.330347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.330347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.330347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.330347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.330347] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.330347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.330347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.330347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.330347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.330347] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8b9ce1a-2b8e-4a65-b28c-620181c45204 already deleted. [ 692.330347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.512399] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8772ae4d-b3d8-4986-b291-e37049ac05b0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.513475] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 34f427e8-f150-431f-960f-584ea344457c with status ACTIVE [ 692.513694] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.513838] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.513903] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.514126] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.514222] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.514434] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.514550] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.514617] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.514762] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.514839] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.519200] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.519338] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.519338] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.519562] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.519665] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.519809] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 34f427e8-f150-431f-960f-584ea344457c is going to be updated. [ 692.521090] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8772ae4d-b3d8-4986-b291-e37049ac05b0 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.521287] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.543463] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.543743] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.543743] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.543933] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.544071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.544245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34f427e8-f150-431f-960f-584ea344457c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.566078] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b in Status: SUCCESS [ 692.566299] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.566511] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.566799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.566999] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.567135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.567200] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.567365] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.567448] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.567533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.567665] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.568566] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.568733] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.568916] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.569270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.569338] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.569486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.569560] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.569656] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.835430] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.835827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.835827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.835941] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.836138] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.836263] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 already deleted. [ 692.836363] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.024873] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8772ae4d-b3d8-4986-b291-e37049ac05b0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.071156] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4fb140-8d8f-45fe-9d42-7405286ea87b taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.072438] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.074268] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.076735] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-326 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.076966] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-326" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.078779] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-326" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.079211] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-326" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.079578] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.080336] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.080479] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.080902] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.081127] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.083344] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.083461] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 693.084125] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 693.084125] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 693.084125] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.084125] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 693.084125] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 693.110379] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 693.110580] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 693.110700] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 693.110947] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-326" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.111416] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-4e3d0fe6-1171-4bdd-bfab-86bb4f7af637 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.111551] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-4e3d0fe6-1171-4bdd-bfab-86bb4f7af637" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.114545] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-4e3d0fe6-1171-4bdd-bfab-86bb4f7af637" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.115070] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-4e3d0fe6-1171-4bdd-bfab-86bb4f7af637" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.115856] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e3d0fe6-1171-4bdd-bfab-86bb4f7af637',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.528794] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.528968] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.529056] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.529279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.529367] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.529471] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8772ae4d-b3d8-4986-b291-e37049ac05b0 is going to be created. [ 693.556245] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.556539] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.556658] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.556916] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.557308] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.574214] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8772ae4d-b3d8-4986-b291-e37049ac05b0 in Status: UNINITIALIZED for 2s [ 693.587106] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.618352] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.618989] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.619271] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.619684] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.620216] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.620216] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 4e3d0fe6-1171-4bdd-bfab-86bb4f7af637 not found, creating... [ 693.620771] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.620771] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.620771] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.620946] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.621021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.621366] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.621536] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.621658] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.621883] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.622498] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.622738] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 4e3d0fe6-1171-4bdd-bfab-86bb4f7af637 is going to be created. [ 693.646300] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.646764] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.647031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.647341] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.647758] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.647991] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-4e3d0fe6-1171-4bdd-bfab-86bb4f7af637" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.092882] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.092882] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.092882] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.092882] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.093361] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.093361] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b is going to be updated. [ 694.131709] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.133400] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.133400] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.133737] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.133807] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.148730] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b in Status: IN_PROGRESS for 2s [ 694.427175] env[69920]: INFO networking_nsxv3.common.synchronization [req-07314485-8dfe-469d-ae2e-d5ef0ec41c3d req-f5ffde25-00e0-4c8f-a3a9-d9dfec5bb4b2 tempest-ServerExternalEventsTest-2037619620 tempest-ServerExternalEventsTest-2037619620-project-member] Enqueued Resource ID: 0da8b432-7927-4b3d-81a7-f990d2563525 with Priority: HIGHEST for action security_group_members [ 694.430073] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0da8b432-7927-4b3d-81a7-f990d2563525 with Priority: HIGHEST for action security_group_members [ 694.430073] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0da8b432-7927-4b3d-81a7-f990d2563525 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.430073] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.430073] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.430073] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.430073] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.430073] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.430073] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.430073] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.430073] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.430073] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0da8b432-7927-4b3d-81a7-f990d2563525',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.555042] env[69920]: INFO networking_nsxv3.common.synchronization [None req-283c2028-f017-47e1-87b5-707dc61787fd None None] Enqueued Resource ID: 17c65088-3af3-46c4-96a1-f2629048ff21 with Priority: HIGHEST for action port [ 694.555334] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17c65088-3af3-46c4-96a1-f2629048ff21 with Priority: HIGHEST for action port [ 694.555979] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-17c65088-3af3-46c4-96a1-f2629048ff21 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.557883] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17c65088-3af3-46c4-96a1-f2629048ff21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.558362] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17c65088-3af3-46c4-96a1-f2629048ff21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.558676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17c65088-3af3-46c4-96a1-f2629048ff21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.558823] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17c65088-3af3-46c4-96a1-f2629048ff21',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.932469] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.932662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.932723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.933662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.933879] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.934153] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.934552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.934654] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.935170] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.935366] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.935663] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0da8b432-7927-4b3d-81a7-f990d2563525 already deleted. [ 694.935663] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.011020] env[69920]: INFO networking_nsxv3.common.synchronization [req-72cf7643-f180-4065-8182-082f74461e7a req-c721f7f3-bfdd-425b-9eac-ae34603e3086 service nova] Enqueued Resource ID: f8b9ce1a-2b8e-4a65-b28c-620181c45204 with Priority: HIGHEST for action security_group_rules [ 695.011020] env[69920]: INFO networking_nsxv3.common.synchronization [req-72cf7643-f180-4065-8182-082f74461e7a req-c721f7f3-bfdd-425b-9eac-ae34603e3086 service nova] Enqueued Resource ID: f8b9ce1a-2b8e-4a65-b28c-620181c45204 with Priority: HIGHEST for action security_group_members [ 695.011020] env[69920]: INFO networking_nsxv3.common.synchronization [req-72cf7643-f180-4065-8182-082f74461e7a req-c721f7f3-bfdd-425b-9eac-ae34603e3086 service nova] Enqueued Resource ID: 4e3d0fe6-1171-4bdd-bfab-86bb4f7af637 with Priority: HIGHEST for action port [ 695.011020] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8b9ce1a-2b8e-4a65-b28c-620181c45204 with Priority: HIGHEST for action security_group_rules [ 695.011020] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8b9ce1a-2b8e-4a65-b28c-620181c45204 with Priority: HIGHEST for action security_group_members [ 695.011020] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e3d0fe6-1171-4bdd-bfab-86bb4f7af637 with Priority: HIGHEST for action port [ 695.011020] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8b9ce1a-2b8e-4a65-b28c-620181c45204 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.011747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.011918] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.012262] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.012453] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8b9ce1a-2b8e-4a65-b28c-620181c45204',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.013861] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8b9ce1a-2b8e-4a65-b28c-620181c45204 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.014128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.014282] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.014591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.015597] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.015597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.015597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.018716] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.018716] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.018716] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8b9ce1a-2b8e-4a65-b28c-620181c45204',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.018716] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e3d0fe6-1171-4bdd-bfab-86bb4f7af637 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.018716] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e3d0fe6-1171-4bdd-bfab-86bb4f7af637" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.018716] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e3d0fe6-1171-4bdd-bfab-86bb4f7af637" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.018716] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e3d0fe6-1171-4bdd-bfab-86bb4f7af637" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.018716] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e3d0fe6-1171-4bdd-bfab-86bb4f7af637',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.064123] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 17c65088-3af3-46c4-96a1-f2629048ff21 [ 695.065217] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.065418] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.065497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.065724] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.065816] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.065904] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:17c65088-3af3-46c4-96a1-f2629048ff21 already deleted. [ 695.065983] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17c65088-3af3-46c4-96a1-f2629048ff21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.158655] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-207 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.159255] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.159445] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.160303] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.160585] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.160759] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.160880] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.161155] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.161327] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.161580] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 695.161702] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 695.162729] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 695.162729] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 695.162729] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 695.162729] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 695.162729] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 695.188719] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 695.188895] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 695.189130] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 695.193517] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.193933] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-68ff56b2-b063-423a-93e6-b3aba5245461 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.194183] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-68ff56b2-b063-423a-93e6-b3aba5245461" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.194320] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-68ff56b2-b063-423a-93e6-b3aba5245461" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.194684] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-68ff56b2-b063-423a-93e6-b3aba5245461" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.194830] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68ff56b2-b063-423a-93e6-b3aba5245461',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.523165] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8b9ce1a-2b8e-4a65-b28c-620181c45204 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.523165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.523165] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8b9ce1a-2b8e-4a65-b28c-620181c45204',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.523165] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e3d0fe6-1171-4bdd-bfab-86bb4f7af637 with status ACTIVE [ 695.523165] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.523165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.523165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.523165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.523165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.523165] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.523165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.523165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.523165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.523165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.523992] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.523992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.523992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.523992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.523992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.523992] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e3d0fe6-1171-4bdd-bfab-86bb4f7af637 is going to be updated. [ 695.548296] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.548690] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.548690] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.548854] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.548955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.549130] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e3d0fe6-1171-4bdd-bfab-86bb4f7af637" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.584708] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8772ae4d-b3d8-4986-b291-e37049ac05b0 in Status: SUCCESS [ 695.585144] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.585243] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.585494] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.589079] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.589079] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.589079] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.589079] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.589079] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.589079] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.589079] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8772ae4d-b3d8-4986-b291-e37049ac05b0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.699030] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.699426] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.699616] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.699929] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.702320] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.702552] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 68ff56b2-b063-423a-93e6-b3aba5245461 not found, creating... [ 695.702870] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.703063] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.703189] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.703542] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.703717] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.704074] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.704212] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.704401] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.704650] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.704796] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.704943] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 68ff56b2-b063-423a-93e6-b3aba5245461 is going to be created. [ 695.729051] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.731019] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.731019] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.731019] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.731019] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.731019] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-68ff56b2-b063-423a-93e6-b3aba5245461" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.029293] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8b9ce1a-2b8e-4a65-b28c-620181c45204',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.094023] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8772ae4d-b3d8-4986-b291-e37049ac05b0 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.094023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.094023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.094023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.094023] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.094023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.094023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.094023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.094023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.094488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.094488] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8772ae4d-b3d8-4986-b291-e37049ac05b0 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.094488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.094906] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.095093] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.095453] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.095592] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.095668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.099033] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.099033] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.099033] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.099033] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8772ae4d-b3d8-4986-b291-e37049ac05b0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.160178] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b in Status: SUCCESS [ 696.160527] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.160721] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.160977] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.161315] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.161455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.161654] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.161769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.161910] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.163585] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.531236] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.531787] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.531787] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.533242] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.533465] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.534021] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8b9ce1a-2b8e-4a65-b28c-620181c45204 is going to be created. [ 696.570152] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.570311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.570421] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.570839] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.570839] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.575241] env[69920]: INFO networking_nsxv3.common.synchronization [req-07314485-8dfe-469d-ae2e-d5ef0ec41c3d req-32958e16-9f34-409f-8d60-10f264d071c3 service nova] Enqueued Resource ID: 0da8b432-7927-4b3d-81a7-f990d2563525 with Priority: HIGHEST for action security_group_rules [ 696.575560] env[69920]: INFO networking_nsxv3.common.synchronization [req-07314485-8dfe-469d-ae2e-d5ef0ec41c3d req-32958e16-9f34-409f-8d60-10f264d071c3 service nova] Enqueued Resource ID: 0da8b432-7927-4b3d-81a7-f990d2563525 with Priority: HIGHEST for action security_group_members [ 696.575971] env[69920]: INFO networking_nsxv3.common.synchronization [req-07314485-8dfe-469d-ae2e-d5ef0ec41c3d req-32958e16-9f34-409f-8d60-10f264d071c3 service nova] Enqueued Resource ID: 68ff56b2-b063-423a-93e6-b3aba5245461 with Priority: HIGHEST for action port [ 696.576660] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0da8b432-7927-4b3d-81a7-f990d2563525 with Priority: HIGHEST for action security_group_rules [ 696.577127] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0da8b432-7927-4b3d-81a7-f990d2563525 with Priority: HIGHEST for action security_group_members [ 696.577127] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68ff56b2-b063-423a-93e6-b3aba5245461 with Priority: HIGHEST for action port [ 696.577415] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0da8b432-7927-4b3d-81a7-f990d2563525 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.577612] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.577725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.578120] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.578262] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0da8b432-7927-4b3d-81a7-f990d2563525',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.579864] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0da8b432-7927-4b3d-81a7-f990d2563525 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.579864] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.580154] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.580611] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.580611] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.582351] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.582351] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.582570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.582647] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.582748] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0da8b432-7927-4b3d-81a7-f990d2563525',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.584060] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-68ff56b2-b063-423a-93e6-b3aba5245461 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.584060] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68ff56b2-b063-423a-93e6-b3aba5245461" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.584060] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68ff56b2-b063-423a-93e6-b3aba5245461" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.584253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68ff56b2-b063-423a-93e6-b3aba5245461" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.585927] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68ff56b2-b063-423a-93e6-b3aba5245461',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.587300] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8b9ce1a-2b8e-4a65-b28c-620181c45204 in Status: UNINITIALIZED for 2s [ 696.599428] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8772ae4d-b3d8-4986-b291-e37049ac05b0: rpc.has_security_group_logging(os_id): False [ 696.621668] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.621668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.621668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.622448] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.622448] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.622448] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.622448] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.622676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.622786] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.623300] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.623300] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.623519] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.623829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.623829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.623924] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.624727] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.624847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.625588] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.625588] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.625588] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.625588] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8772ae4d-b3d8-4986-b291-e37049ac05b0 is going to be created. [ 696.666736] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.702921] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.702921] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.702921] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.702921] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.702921] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.718149] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8772ae4d-b3d8-4986-b291-e37049ac05b0 in Status: IN_PROGRESS for 2s [ 696.842284] env[69920]: INFO networking_nsxv3.common.synchronization [req-84dc20c4-ebcd-47df-be3c-8938be877144 req-7a61fef2-cd6b-460e-a07e-3911f9cd172f tempest-VolumesAssistedSnapshotsTest-131898001 tempest-VolumesAssistedSnapshotsTest-131898001-project-member] Enqueued Resource ID: b6124cb4-db5b-4093-b85f-7d68bc614215 with Priority: HIGHEST for action security_group_members [ 696.842903] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6124cb4-db5b-4093-b85f-7d68bc614215 with Priority: HIGHEST for action security_group_members [ 696.844726] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6124cb4-db5b-4093-b85f-7d68bc614215 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.845442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.845442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.845442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.845667] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.845758] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.845851] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.845962] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.846106] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.846215] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6124cb4-db5b-4093-b85f-7d68bc614215',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.923864] env[69920]: INFO networking_nsxv3.common.synchronization [None req-08877862-a8e3-4c55-bf57-0d5d6d777244 None None] Enqueued Resource ID: a7822e2a-091d-4bc6-b72c-a7647308e64f with Priority: HIGHEST for action port [ 696.923864] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7822e2a-091d-4bc6-b72c-a7647308e64f with Priority: HIGHEST for action port [ 696.924783] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7822e2a-091d-4bc6-b72c-a7647308e64f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.924783] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7822e2a-091d-4bc6-b72c-a7647308e64f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.924783] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7822e2a-091d-4bc6-b72c-a7647308e64f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.925683] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7822e2a-091d-4bc6-b72c-a7647308e64f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.925683] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7822e2a-091d-4bc6-b72c-a7647308e64f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.086539] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0da8b432-7927-4b3d-81a7-f990d2563525',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.087573] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0da8b432-7927-4b3d-81a7-f990d2563525 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.087573] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.088576] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68ff56b2-b063-423a-93e6-b3aba5245461 with status ACTIVE [ 697.088576] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.088576] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.088576] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.088810] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.088810] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.089063] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.090362] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.090449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.090663] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.090781] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.091074] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.091192] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.091275] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.091525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.091756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.091909] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68ff56b2-b063-423a-93e6-b3aba5245461 is going to be updated. [ 697.117028] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.117229] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.117293] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.117494] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.117874] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.117874] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68ff56b2-b063-423a-93e6-b3aba5245461" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.172213] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.349717] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.350416] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.350416] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.350416] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.350416] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.350611] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.350707] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.350766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.351208] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.351208] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.351208] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6124cb4-db5b-4093-b85f-7d68bc614215 already deleted. [ 697.351208] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.429055] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7822e2a-091d-4bc6-b72c-a7647308e64f [ 697.429221] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.429434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.429568] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.429742] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.429807] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.429858] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7822e2a-091d-4bc6-b72c-a7647308e64f already deleted. [ 697.429955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7822e2a-091d-4bc6-b72c-a7647308e64f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.594678] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0da8b432-7927-4b3d-81a7-f990d2563525',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.677175] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.677175] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.677175] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.677175] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.677175] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.677175] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b is going to be updated. [ 697.711023] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.711023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.711023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.711023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.711023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.721398] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b in Status: IN_PROGRESS for 2s [ 697.826012] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-18 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.826012] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-18" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.826012] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-18" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.826012] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-18" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.826012] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.826012] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.826012] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.826421] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.826421] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.826622] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 697.826731] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 697.826832] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 697.826940] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 697.827070] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 697.827180] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 697.827312] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 697.848153] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 697.848153] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 697.849355] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 697.849355] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-18" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.849355] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-9a088536-28fd-4645-87ba-e071c754db1e taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.849742] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-9a088536-28fd-4645-87ba-e071c754db1e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.849742] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-9a088536-28fd-4645-87ba-e071c754db1e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.850120] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-9a088536-28fd-4645-87ba-e071c754db1e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.850369] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a088536-28fd-4645-87ba-e071c754db1e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.097547] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.097891] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.097988] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.098230] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.098326] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.098501] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0da8b432-7927-4b3d-81a7-f990d2563525 is going to be created. [ 698.127310] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.127461] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.127527] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.128313] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.128313] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.141563] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0da8b432-7927-4b3d-81a7-f990d2563525 in Status: UNINITIALIZED for 2s [ 698.353231] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.353837] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.353917] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.354259] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.354414] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.354577] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 9a088536-28fd-4645-87ba-e071c754db1e not found, creating... [ 698.354853] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.355136] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.356474] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.356474] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.356474] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.356474] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.356474] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.356474] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.356474] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.356778] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.356778] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 9a088536-28fd-4645-87ba-e071c754db1e is going to be created. [ 698.377854] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.378086] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.378226] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.379117] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.379117] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.379117] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-9a088536-28fd-4645-87ba-e071c754db1e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.604371] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8b9ce1a-2b8e-4a65-b28c-620181c45204 in Status: SUCCESS [ 698.604677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.605830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.605830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.605830] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.605830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.605830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.605830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.606370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.606370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.606370] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8b9ce1a-2b8e-4a65-b28c-620181c45204',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.735917] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8772ae4d-b3d8-4986-b291-e37049ac05b0 in Status: SUCCESS [ 698.736241] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.115940] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8b9ce1a-2b8e-4a65-b28c-620181c45204 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.116121] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.116192] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.116424] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.116597] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.116700] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.116764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.116917] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.117014] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.117107] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.118100] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8b9ce1a-2b8e-4a65-b28c-620181c45204 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.118282] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.118350] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.118510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.118655] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.118752] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.119016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.120484] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.120611] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.120711] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.120808] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8b9ce1a-2b8e-4a65-b28c-620181c45204',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.141520] env[69920]: INFO networking_nsxv3.common.synchronization [None req-c5472f6c-ea4b-4f6b-b36f-e3e277bed0ef None None] Enqueued Resource ID: 7ff724c1-c141-4395-83b3-de3b226cceac with Priority: HIGHEST for action port [ 699.142690] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ff724c1-c141-4395-83b3-de3b226cceac with Priority: HIGHEST for action port [ 699.144113] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ff724c1-c141-4395-83b3-de3b226cceac taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.144339] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ff724c1-c141-4395-83b3-de3b226cceac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.144446] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ff724c1-c141-4395-83b3-de3b226cceac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.144786] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ff724c1-c141-4395-83b3-de3b226cceac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.144877] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ff724c1-c141-4395-83b3-de3b226cceac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.624628] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8b9ce1a-2b8e-4a65-b28c-620181c45204: rpc.has_security_group_logging(os_id): False [ 699.643975] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.644255] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.644255] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.644526] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.644640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.645476] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.645476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.645476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.645476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.645476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.645476] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.645771] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.645771] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.645771] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.645864] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.645965] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.646273] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.646353] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.646516] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.646605] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.646699] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8b9ce1a-2b8e-4a65-b28c-620181c45204 is going to be created. [ 699.647880] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ff724c1-c141-4395-83b3-de3b226cceac [ 699.648087] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.648201] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.648269] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.648429] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.648509] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.648751] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ff724c1-c141-4395-83b3-de3b226cceac already deleted. [ 699.648751] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ff724c1-c141-4395-83b3-de3b226cceac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.718166] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.718166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.718166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.718513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.718647] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.731043] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b in Status: SUCCESS [ 699.731281] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.731511] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.731731] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.731928] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.732117] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.732225] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.732439] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.732528] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.732617] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.732786] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4fb140-8d8f-45fe-9d42-7405286ea87b taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.732896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.732959] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.733446] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.733679] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.733848] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.733944] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.734191] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.734350] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.734464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.735581] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.736439] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8b9ce1a-2b8e-4a65-b28c-620181c45204 in Status: IN_PROGRESS for 2s [ 699.758265] env[69920]: INFO networking_nsxv3.common.synchronization [req-84dc20c4-ebcd-47df-be3c-8938be877144 req-011caffb-065b-448a-b85a-87a60bba0995 service nova] Enqueued Resource ID: b6124cb4-db5b-4093-b85f-7d68bc614215 with Priority: HIGHEST for action security_group_rules [ 699.758265] env[69920]: INFO networking_nsxv3.common.synchronization [req-84dc20c4-ebcd-47df-be3c-8938be877144 req-011caffb-065b-448a-b85a-87a60bba0995 service nova] Enqueued Resource ID: b6124cb4-db5b-4093-b85f-7d68bc614215 with Priority: HIGHEST for action security_group_members [ 699.758375] env[69920]: INFO networking_nsxv3.common.synchronization [req-84dc20c4-ebcd-47df-be3c-8938be877144 req-011caffb-065b-448a-b85a-87a60bba0995 service nova] Enqueued Resource ID: 9a088536-28fd-4645-87ba-e071c754db1e with Priority: HIGHEST for action port [ 699.758925] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6124cb4-db5b-4093-b85f-7d68bc614215 with Priority: HIGHEST for action security_group_rules [ 699.759092] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6124cb4-db5b-4093-b85f-7d68bc614215 with Priority: HIGHEST for action security_group_members [ 699.759195] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a088536-28fd-4645-87ba-e071c754db1e with Priority: HIGHEST for action port [ 699.759967] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6124cb4-db5b-4093-b85f-7d68bc614215 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.760129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.760199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.760457] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.760502] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6124cb4-db5b-4093-b85f-7d68bc614215',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.761348] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6124cb4-db5b-4093-b85f-7d68bc614215 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.761475] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.761558] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.761783] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.761936] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.762076] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.762137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.762287] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.762373] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.762481] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6124cb4-db5b-4093-b85f-7d68bc614215',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.763412] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a088536-28fd-4645-87ba-e071c754db1e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.763502] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a088536-28fd-4645-87ba-e071c754db1e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.763555] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a088536-28fd-4645-87ba-e071c754db1e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.763729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a088536-28fd-4645-87ba-e071c754db1e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.763813] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a088536-28fd-4645-87ba-e071c754db1e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.154389] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0da8b432-7927-4b3d-81a7-f990d2563525 in Status: SUCCESS [ 700.155015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.155015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.158387] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.158387] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.158387] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.158387] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.158387] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.158387] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.158387] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.158387] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0da8b432-7927-4b3d-81a7-f990d2563525',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.238159] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b4fb140-8d8f-45fe-9d42-7405286ea87b: rpc.has_security_group_logging(os_id): False [ 700.260822] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.260822] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.260822] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.260822] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.260822] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.260822] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.261203] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.261203] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.261672] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.261817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.262109] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.262216] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.262299] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.262485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.263099] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.263099] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.263099] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.263099] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.263099] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.263363] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.263413] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b is going to be created. [ 700.265137] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6124cb4-db5b-4093-b85f-7d68bc614215',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.266201] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6124cb4-db5b-4093-b85f-7d68bc614215 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.266361] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.266983] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a088536-28fd-4645-87ba-e071c754db1e with status ACTIVE [ 700.266983] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.267126] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.267126] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.267773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.267773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.267773] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.267773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.267773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.268308] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.268308] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.268308] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.268308] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.268528] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.268528] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.268592] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.268623] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a088536-28fd-4645-87ba-e071c754db1e is going to be updated. [ 700.289151] env[69920]: INFO networking_nsxv3.common.synchronization [req-24600340-58ce-4be4-8190-29a12fe9006b req-a7f2083b-ac14-407f-8ca4-8e1ce982e809 tempest-ImagesTestJSON-210893687 tempest-ImagesTestJSON-210893687-project-member] Enqueued Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 700.289151] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 700.290174] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.290372] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.290497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.294756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.294756] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.294756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.294756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.294756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.294756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.297058] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.300049] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.300049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.300049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.300485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.300818] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.301071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a088536-28fd-4645-87ba-e071c754db1e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.345128] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.345273] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.345354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.345571] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.345847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.361996] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b in Status: IN_PROGRESS for 2s [ 700.660976] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0da8b432-7927-4b3d-81a7-f990d2563525 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.664547] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.664547] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.664547] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.664547] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.664547] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.664547] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.664547] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.664547] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.664547] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.664547] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0da8b432-7927-4b3d-81a7-f990d2563525 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.664962] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.664962] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.664962] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.664962] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.665110] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.665142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.665966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.665966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.665966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.668017] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0da8b432-7927-4b3d-81a7-f990d2563525',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.767922] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6124cb4-db5b-4093-b85f-7d68bc614215',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.800024] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.800024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.800024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.800024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.800024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.800024] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.800024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.800024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.800024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.800024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.800024] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 already deleted. [ 700.800024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.907212] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-203 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.907212] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-203" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.907212] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-203" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.907212] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-203" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.907487] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.907661] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.907782] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.908101] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.908434] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.908714] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 700.908827] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 700.908931] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 700.909048] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 700.909184] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 700.909270] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 700.909448] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 700.933836] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 700.933836] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 700.933836] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 700.934337] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-203" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.934337] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-e4473f09-99e5-4ac3-b9cc-3316e06abd65 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.934533] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-e4473f09-99e5-4ac3-b9cc-3316e06abd65" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.934661] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-e4473f09-99e5-4ac3-b9cc-3316e06abd65" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.935010] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-e4473f09-99e5-4ac3-b9cc-3316e06abd65" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.935113] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4473f09-99e5-4ac3-b9cc-3316e06abd65',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.172349] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0da8b432-7927-4b3d-81a7-f990d2563525: rpc.has_security_group_logging(os_id): False [ 701.196429] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.196629] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.196629] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.196967] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.197013] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.197282] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.197745] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.197745] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.197745] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.197745] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.197946] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.198009] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.201266] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.202044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.202044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.202044] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.202318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.202318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.202390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.202787] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.202925] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0da8b432-7927-4b3d-81a7-f990d2563525 is going to be created. [ 701.273155] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.273155] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.273155] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.273155] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.273155] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.273155] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6124cb4-db5b-4093-b85f-7d68bc614215 is going to be created. [ 701.300580] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.303029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.303029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.303029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.303029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.320711] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0da8b432-7927-4b3d-81a7-f990d2563525 in Status: IN_PROGRESS for 2s [ 701.327278] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.327278] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.327278] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.327278] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.327278] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.340860] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6124cb4-db5b-4093-b85f-7d68bc614215 in Status: UNINITIALIZED for 2s [ 701.441171] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.441171] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.441171] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.441171] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.441171] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.441171] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port e4473f09-99e5-4ac3-b9cc-3316e06abd65 not found, creating... [ 701.441171] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.443049] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.443567] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.444324] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.444653] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.445423] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.446661] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.446661] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.446661] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.446661] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.446661] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: e4473f09-99e5-4ac3-b9cc-3316e06abd65 is going to be created. [ 701.472826] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.473032] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.473171] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.473510] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.473750] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.473995] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-e4473f09-99e5-4ac3-b9cc-3316e06abd65" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.655650] env[69920]: INFO networking_nsxv3.common.synchronization [None req-125a29bd-f943-454e-83da-9cad61fa9567 None None] Enqueued Resource ID: 37c47aa7-516d-4e94-85eb-d53353f781bf with Priority: HIGHEST for action port [ 701.656483] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37c47aa7-516d-4e94-85eb-d53353f781bf with Priority: HIGHEST for action port [ 701.659062] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-37c47aa7-516d-4e94-85eb-d53353f781bf taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.659335] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37c47aa7-516d-4e94-85eb-d53353f781bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.659335] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37c47aa7-516d-4e94-85eb-d53353f781bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.659606] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37c47aa7-516d-4e94-85eb-d53353f781bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.659696] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37c47aa7-516d-4e94-85eb-d53353f781bf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.752244] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8b9ce1a-2b8e-4a65-b28c-620181c45204 in Status: SUCCESS [ 701.752244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.867189] env[69920]: INFO networking_nsxv3.common.synchronization [None req-0ecb6528-23ac-4da9-9f46-8d64f4c7e532 None None] Enqueued Resource ID: 12d9cac4-50f6-4bb9-a1d0-7be49256489a with Priority: HIGHEST for action port [ 701.870919] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12d9cac4-50f6-4bb9-a1d0-7be49256489a with Priority: HIGHEST for action port [ 701.870919] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-12d9cac4-50f6-4bb9-a1d0-7be49256489a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.870919] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12d9cac4-50f6-4bb9-a1d0-7be49256489a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.870919] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12d9cac4-50f6-4bb9-a1d0-7be49256489a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.870919] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12d9cac4-50f6-4bb9-a1d0-7be49256489a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.870919] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12d9cac4-50f6-4bb9-a1d0-7be49256489a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.162817] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 37c47aa7-516d-4e94-85eb-d53353f781bf [ 702.165788] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.165788] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.165788] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.165788] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.165788] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.165788] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:37c47aa7-516d-4e94-85eb-d53353f781bf already deleted. [ 702.165788] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37c47aa7-516d-4e94-85eb-d53353f781bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.373037] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12d9cac4-50f6-4bb9-a1d0-7be49256489a [ 702.373037] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.373037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.373037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.373314] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.373969] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.373969] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12d9cac4-50f6-4bb9-a1d0-7be49256489a already deleted. [ 702.373969] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12d9cac4-50f6-4bb9-a1d0-7be49256489a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.376908] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b in Status: SUCCESS [ 702.376908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.376908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.377082] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.377121] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.728472] env[69920]: INFO networking_nsxv3.common.synchronization [None req-e4d71eb9-60a6-4321-8c6a-cf5413e3f007 tempest-VolumesAdminNegativeTest-1491739297 tempest-VolumesAdminNegativeTest-1491739297-project-member] Enqueued Resource ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac with Priority: HIGHEST for action security_group_rules [ 702.729175] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac with Priority: HIGHEST for action security_group_rules [ 702.729497] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.729625] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.729691] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.730197] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.730299] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.859230] env[69920]: INFO networking_nsxv3.common.synchronization [None req-f431f494-f816-429c-be32-9a44ba7d2052 tempest-VolumesAdminNegativeTest-1491739297 tempest-VolumesAdminNegativeTest-1491739297-project-member] Enqueued Resource ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac with Priority: HIGHEST for action security_group_rules [ 702.861841] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac with Priority: HIGHEST for action security_group_rules [ 702.861841] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.861841] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.882196] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4fb140-8d8f-45fe-9d42-7405286ea87b taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.882417] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.882500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.882754] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.882961] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.884323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.884323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.884323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.884323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.884323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.884323] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.255890] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.256109] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.256241] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.256351] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.256454] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.256569] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac already deleted. [ 703.256654] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.256855] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.260384] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.260513] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.280717] env[69920]: INFO networking_nsxv3.common.synchronization [req-24600340-58ce-4be4-8190-29a12fe9006b req-9cc7b0c2-a880-4395-8aa0-9bc0ee67f904 service nova] Enqueued Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_rules [ 703.280989] env[69920]: INFO networking_nsxv3.common.synchronization [req-24600340-58ce-4be4-8190-29a12fe9006b req-9cc7b0c2-a880-4395-8aa0-9bc0ee67f904 service nova] Enqueued Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 703.282370] env[69920]: INFO networking_nsxv3.common.synchronization [req-24600340-58ce-4be4-8190-29a12fe9006b req-9cc7b0c2-a880-4395-8aa0-9bc0ee67f904 service nova] Enqueued Resource ID: e4473f09-99e5-4ac3-b9cc-3316e06abd65 with Priority: HIGHEST for action port [ 703.284146] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_rules [ 703.284146] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 703.284146] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4473f09-99e5-4ac3-b9cc-3316e06abd65 with Priority: HIGHEST for action port [ 703.284146] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.284146] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.284146] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.285783] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.286370] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.287800] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.287800] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.287800] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.287800] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.287987] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.287987] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.288129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.288210] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.288305] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.288395] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.291925] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4473f09-99e5-4ac3-b9cc-3316e06abd65 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.292140] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4473f09-99e5-4ac3-b9cc-3316e06abd65" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.292140] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4473f09-99e5-4ac3-b9cc-3316e06abd65" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.292346] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4473f09-99e5-4ac3-b9cc-3316e06abd65" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.293827] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4473f09-99e5-4ac3-b9cc-3316e06abd65',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.335538] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0da8b432-7927-4b3d-81a7-f990d2563525 in Status: SUCCESS [ 703.335785] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.351845] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6124cb4-db5b-4093-b85f-7d68bc614215 in Status: SUCCESS [ 703.355080] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.355678] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.355678] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.356499] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.356702] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.356859] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.357069] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.357647] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.357647] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.357647] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6124cb4-db5b-4093-b85f-7d68bc614215',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.388166] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4fb140-8d8f-45fe-9d42-7405286ea87b taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.388166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.388166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.388166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.388166] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.388166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.388166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.388166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.388166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.388166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.388166] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4fb140-8d8f-45fe-9d42-7405286ea87b taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.388166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.388166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.388166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.392105] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.392276] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.392339] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.392527] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.392618] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.392727] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.393510] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.786921] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.787566] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.788056] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.788310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.788984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.788984] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac already deleted. [ 703.788984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.800068] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.800068] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.800068] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.800068] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4473f09-99e5-4ac3-b9cc-3316e06abd65 with status ACTIVE [ 703.800068] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.800068] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.800068] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.800068] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.800068] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.800068] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.800068] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.800068] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.800068] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.800068] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.800843] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.800843] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.800843] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.800843] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.801399] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.802645] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4473f09-99e5-4ac3-b9cc-3316e06abd65 is going to be updated. [ 703.828557] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.828557] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.828557] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.828557] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.828557] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.828557] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4473f09-99e5-4ac3-b9cc-3316e06abd65" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.863156] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6124cb4-db5b-4093-b85f-7d68bc614215',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.898740] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b4fb140-8d8f-45fe-9d42-7405286ea87b: rpc.has_security_group_logging(os_id): False [ 703.930285] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.930285] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.930285] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.930285] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.930285] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.930285] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.930285] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.930285] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.930285] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.930285] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.931799] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.931799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.931799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.931799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.932429] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.932576] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.932686] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.932772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.932928] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.933035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.933604] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b is going to be updated. [ 704.064587] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.064850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.064943] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.065164] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.065369] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.088810] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b in Status: IN_PROGRESS for 2s [ 704.299203] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.366746] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6124cb4-db5b-4093-b85f-7d68bc614215: rpc.has_security_group_logging(os_id): False [ 704.394247] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.394247] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.394247] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.394247] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.394247] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.394247] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.394247] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.394247] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.394247] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.394247] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.394247] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6124cb4-db5b-4093-b85f-7d68bc614215 is going to be created. [ 704.463141] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.463273] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.463700] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.463700] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.463844] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.474569] env[69920]: INFO networking_nsxv3.common.synchronization [req-e06695da-9e50-47e0-a991-92cd4d97661e req-3fa8ebab-e159-467d-9142-0352def6c71f tempest-ListServersNegativeTestJSON-2142759027 tempest-ListServersNegativeTestJSON-2142759027-project-member] Enqueued Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_members [ 704.475458] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6124cb4-db5b-4093-b85f-7d68bc614215 in Status: IN_PROGRESS for 2s [ 704.475916] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_members [ 704.479313] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4fb140-8d8f-45fe-9d42-7405286ea87b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.479447] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.479520] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.479728] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.479888] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.479983] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.480409] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.480409] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.480409] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.480536] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.512027] env[69920]: INFO networking_nsxv3.common.synchronization [None req-0e90cdaa-474f-47c5-a65a-1fa2c0a975cf None None] Enqueued Resource ID: 82b34939-13bc-4adc-adad-a48e0e5b6cdc with Priority: HIGHEST for action port [ 704.512027] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82b34939-13bc-4adc-adad-a48e0e5b6cdc with Priority: HIGHEST for action port [ 704.512283] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-82b34939-13bc-4adc-adad-a48e0e5b6cdc taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.512413] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82b34939-13bc-4adc-adad-a48e0e5b6cdc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.512476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82b34939-13bc-4adc-adad-a48e0e5b6cdc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.512742] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82b34939-13bc-4adc-adad-a48e0e5b6cdc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.512822] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82b34939-13bc-4adc-adad-a48e0e5b6cdc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.726621] env[69920]: INFO networking_nsxv3.common.synchronization [req-d51a75ba-ac50-4c1c-8f8a-62cc87a94395 req-73374789-9737-4a26-901b-c2ea59799bd3 tempest-FloatingIPsAssociationTestJSON-1358918757 tempest-FloatingIPsAssociationTestJSON-1358918757-project-member] Enqueued Resource ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd with Priority: HIGHEST for action security_group_members [ 704.726865] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd with Priority: HIGHEST for action security_group_members [ 704.727442] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-40f3bd9f-8637-49e8-92cd-03812c846cfd taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.727597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.727699] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.728139] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.728291] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.728361] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.728361] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.728529] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.728596] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.728696] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.802873] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.802873] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.802873] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.803943] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.803943] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.803943] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 is going to be created. [ 704.832815] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.833001] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.833082] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.833900] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.833900] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.845776] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: UNINITIALIZED for 2s [ 704.985260] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.015285] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82b34939-13bc-4adc-adad-a48e0e5b6cdc [ 705.017887] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.017887] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.017887] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.017887] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.017887] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.017887] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82b34939-13bc-4adc-adad-a48e0e5b6cdc already deleted. [ 705.017887] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82b34939-13bc-4adc-adad-a48e0e5b6cdc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.232476] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.232650] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.232720] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.232906] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.233012] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.233219] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.233334] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.233392] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.233651] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.233651] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.233772] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd already deleted. [ 705.233837] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.457193] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.457193] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-668" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.457193] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-668" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.457193] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-668" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.457193] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.457193] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.457193] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.459677] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.459677] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.459677] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 705.459677] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 705.459677] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 705.459677] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 705.459677] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 705.459677] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 705.459677] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 705.484811] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 705.484975] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 705.485129] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 705.485310] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-668" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.485638] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-5615148b-36c9-40b6-9282-76bdcfb9931e taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.485851] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-5615148b-36c9-40b6-9282-76bdcfb9931e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.485998] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-5615148b-36c9-40b6-9282-76bdcfb9931e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.486342] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-5615148b-36c9-40b6-9282-76bdcfb9931e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.486488] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5615148b-36c9-40b6-9282-76bdcfb9931e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.489171] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.991137] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.991875] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.991875] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.991952] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.992142] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.992379] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 5615148b-36c9-40b6-9282-76bdcfb9931e not found, creating... [ 705.992883] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.993377] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.993605] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.993865] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.997976] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.998551] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.998943] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.999013] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.999392] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.999634] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.000103] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 5615148b-36c9-40b6-9282-76bdcfb9931e is going to be created. [ 706.001775] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.001775] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.001775] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.002226] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.002226] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.002226] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b is going to be updated. [ 706.037027] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.037027] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.037027] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.037027] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.037417] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.037555] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-5615148b-36c9-40b6-9282-76bdcfb9931e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.049236] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.049370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.049819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.049819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.049819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.061475] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b in Status: IN_PROGRESS for 2s [ 706.112453] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b in Status: SUCCESS [ 706.112453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.112453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.112453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.112762] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.493087] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6124cb4-db5b-4093-b85f-7d68bc614215 in Status: SUCCESS [ 706.493430] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.617239] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4fb140-8d8f-45fe-9d42-7405286ea87b taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.617413] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.861514] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: SUCCESS [ 706.861662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.861749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.862285] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.862347] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.862535] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.862535] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.862712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.862798] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.862907] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.864044] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.286025] env[69920]: INFO networking_nsxv3.common.synchronization [req-d51a75ba-ac50-4c1c-8f8a-62cc87a94395 req-8f150854-2098-4d83-bb42-55e2c269bb7e service nova] Enqueued Resource ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd with Priority: HIGHEST for action security_group_rules [ 707.286025] env[69920]: INFO networking_nsxv3.common.synchronization [req-d51a75ba-ac50-4c1c-8f8a-62cc87a94395 req-8f150854-2098-4d83-bb42-55e2c269bb7e service nova] Enqueued Resource ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd with Priority: HIGHEST for action security_group_members [ 707.286025] env[69920]: INFO networking_nsxv3.common.synchronization [req-d51a75ba-ac50-4c1c-8f8a-62cc87a94395 req-8f150854-2098-4d83-bb42-55e2c269bb7e service nova] Enqueued Resource ID: 5615148b-36c9-40b6-9282-76bdcfb9931e with Priority: HIGHEST for action port [ 707.286025] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd with Priority: HIGHEST for action security_group_rules [ 707.286604] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd with Priority: HIGHEST for action security_group_members [ 707.286604] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5615148b-36c9-40b6-9282-76bdcfb9931e with Priority: HIGHEST for action port [ 707.286604] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40f3bd9f-8637-49e8-92cd-03812c846cfd taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.286604] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.286896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.288245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.288245] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.288245] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-40f3bd9f-8637-49e8-92cd-03812c846cfd taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.288245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.289025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.289025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.289025] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.289025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.289025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.289025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.289025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.289867] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.290063] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-5615148b-36c9-40b6-9282-76bdcfb9931e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.290195] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5615148b-36c9-40b6-9282-76bdcfb9931e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.291208] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5615148b-36c9-40b6-9282-76bdcfb9931e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.291208] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5615148b-36c9-40b6-9282-76bdcfb9931e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.291208] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5615148b-36c9-40b6-9282-76bdcfb9931e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.336758] env[69920]: INFO networking_nsxv3.common.synchronization [req-1f511d31-ee37-4135-8b1f-078960dd8544 req-833328ee-0967-4ffd-8ae3-8476859f9b9e tempest-ServersTestBootFromVolume-1196685189 tempest-ServersTestBootFromVolume-1196685189-project-member] Enqueued Resource ID: 361f5d4b-d775-40f2-9486-50f4511d4852 with Priority: HIGHEST for action security_group_members [ 707.338969] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 361f5d4b-d775-40f2-9486-50f4511d4852 with Priority: HIGHEST for action security_group_members [ 707.338969] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-361f5d4b-d775-40f2-9486-50f4511d4852 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.338969] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.338969] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.338969] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.339298] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.339298] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.339298] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.339465] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.340041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.340041] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('361f5d4b-d775-40f2-9486-50f4511d4852',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.365348] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.365592] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.365717] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.365994] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.366203] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.366345] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.366383] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.366581] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.366659] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.366755] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.366937] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.367049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.367114] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.367308] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.367425] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.367558] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.367903] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.368925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.368925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.368925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.369084] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.794561] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-40f3bd9f-8637-49e8-92cd-03812c846cfd taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.794710] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.794900] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.795972] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5615148b-36c9-40b6-9282-76bdcfb9931e with status ACTIVE [ 707.796100] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.796191] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.796268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.796508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.796561] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.796738] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.800399] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.800523] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.800741] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.800831] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.801277] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.801429] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.801499] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.801670] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.801806] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.801859] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5615148b-36c9-40b6-9282-76bdcfb9931e is going to be updated. [ 707.824766] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.824961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.824961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.825175] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.825329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.825474] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5615148b-36c9-40b6-9282-76bdcfb9931e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.843219] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.843382] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.843500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.843717] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.843812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.844018] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.844113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.844179] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.844332] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.844417] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.844505] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 361f5d4b-d775-40f2-9486-50f4511d4852 already deleted. [ 707.844590] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.872020] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1712776d-764c-405e-85d0-105070b4c2e8: rpc.has_security_group_logging(os_id): False [ 707.906811] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.907036] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.907114] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.907323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.907414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.907667] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.907796] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.908020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.908020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.908176] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.908294] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.908388] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.908444] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.908562] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.908670] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.908897] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.909023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.909089] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.909281] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.909354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.909393] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 is going to be created. [ 708.033573] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.033816] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.033816] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.034058] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.034250] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.047640] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: IN_PROGRESS for 2s [ 708.072063] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b in Status: SUCCESS [ 708.072284] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.072455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.072679] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.072879] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.073043] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.073132] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.073337] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.073530] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.073766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.073766] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.304917] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-609 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.304917] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-609" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.304917] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-609" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.306128] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-609" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.307683] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.307878] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.308013] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.308273] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.308419] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.308659] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 708.308775] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 708.309266] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 708.309266] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 708.309266] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 708.309266] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 708.309431] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 708.312551] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.333674] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 708.333760] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 708.333897] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 708.334111] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-609" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.334433] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-043de9ef-5509-4243-acb7-a19660d6d813 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.334597] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-043de9ef-5509-4243-acb7-a19660d6d813" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.334713] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-043de9ef-5509-4243-acb7-a19660d6d813" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.336056] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-043de9ef-5509-4243-acb7-a19660d6d813" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.336237] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('043de9ef-5509-4243-acb7-a19660d6d813',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.577895] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4fb140-8d8f-45fe-9d42-7405286ea87b taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.578129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.578231] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.578494] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.578700] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.578834] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.578924] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.579143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.579250] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.579364] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.579582] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4fb140-8d8f-45fe-9d42-7405286ea87b taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.579708] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.580032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.580032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.580215] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.580346] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.580444] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.580638] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.580744] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.580866] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.580969] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.819451] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.819451] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.819451] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.820018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.820155] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.820249] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd is going to be created. [ 708.838246] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.838502] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.838628] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.838923] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.839095] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.839810] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 043de9ef-5509-4243-acb7-a19660d6d813 not found, creating... [ 708.840163] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.840426] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.840578] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.841190] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.841190] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.841696] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.841873] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.841975] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.842270] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.842413] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.842566] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 043de9ef-5509-4243-acb7-a19660d6d813 is going to be created. [ 708.857911] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.858195] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.858195] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.858494] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.858649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.870998] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.871267] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.871418] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.871758] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.871999] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.872292] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-043de9ef-5509-4243-acb7-a19660d6d813" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.877572] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd in Status: UNINITIALIZED for 2s [ 709.084115] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b4fb140-8d8f-45fe-9d42-7405286ea87b: rpc.has_security_group_logging(os_id): False [ 709.104430] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.104768] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.104910] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.105308] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.105462] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.105864] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.107966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.107966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.107966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.107966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.107966] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.107966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.107966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.108761] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.108761] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.108761] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.108761] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.108761] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.108761] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.108761] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.109573] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b is going to be updated. [ 709.204975] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.205123] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.205208] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.205434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.205583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.230201] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b in Status: IN_PROGRESS for 2s [ 709.254639] env[69920]: INFO networking_nsxv3.common.synchronization [None req-b78d7b33-3882-4054-a5b1-cc00864b65e7 None None] Enqueued Resource ID: a865d206-a560-490f-8cbb-cbc276456636 with Priority: HIGHEST for action port [ 709.257887] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a865d206-a560-490f-8cbb-cbc276456636 with Priority: HIGHEST for action port [ 709.259355] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-a865d206-a560-490f-8cbb-cbc276456636 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.259526] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a865d206-a560-490f-8cbb-cbc276456636" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.259618] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a865d206-a560-490f-8cbb-cbc276456636" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.259997] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a865d206-a560-490f-8cbb-cbc276456636" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.260118] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a865d206-a560-490f-8cbb-cbc276456636',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.762879] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a865d206-a560-490f-8cbb-cbc276456636 [ 709.763636] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.763636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.763636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.763636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.763636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.763872] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a865d206-a560-490f-8cbb-cbc276456636 already deleted. [ 709.763872] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a865d206-a560-490f-8cbb-cbc276456636" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.066543] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: SUCCESS [ 710.066543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.205727] env[69920]: INFO networking_nsxv3.common.synchronization [req-1f511d31-ee37-4135-8b1f-078960dd8544 req-f8a1bf78-93a2-49bf-8f4f-4db2935fd7a3 service nova] Enqueued Resource ID: 361f5d4b-d775-40f2-9486-50f4511d4852 with Priority: HIGHEST for action security_group_rules [ 710.206723] env[69920]: INFO networking_nsxv3.common.synchronization [req-1f511d31-ee37-4135-8b1f-078960dd8544 req-f8a1bf78-93a2-49bf-8f4f-4db2935fd7a3 service nova] Enqueued Resource ID: 361f5d4b-d775-40f2-9486-50f4511d4852 with Priority: HIGHEST for action security_group_members [ 710.206723] env[69920]: INFO networking_nsxv3.common.synchronization [req-1f511d31-ee37-4135-8b1f-078960dd8544 req-f8a1bf78-93a2-49bf-8f4f-4db2935fd7a3 service nova] Enqueued Resource ID: 043de9ef-5509-4243-acb7-a19660d6d813 with Priority: HIGHEST for action port [ 710.206723] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 361f5d4b-d775-40f2-9486-50f4511d4852 with Priority: HIGHEST for action security_group_rules [ 710.207440] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 361f5d4b-d775-40f2-9486-50f4511d4852 with Priority: HIGHEST for action security_group_members [ 710.212574] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 043de9ef-5509-4243-acb7-a19660d6d813 with Priority: HIGHEST for action port [ 710.212574] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-361f5d4b-d775-40f2-9486-50f4511d4852 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.212574] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.212574] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.212574] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.212574] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('361f5d4b-d775-40f2-9486-50f4511d4852',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.212574] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-361f5d4b-d775-40f2-9486-50f4511d4852 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.212574] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.212574] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.212574] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.212574] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.212574] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.213041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.214084] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.214220] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.214712] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('361f5d4b-d775-40f2-9486-50f4511d4852',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.216544] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-043de9ef-5509-4243-acb7-a19660d6d813 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.216686] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-043de9ef-5509-4243-acb7-a19660d6d813" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.216752] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-043de9ef-5509-4243-acb7-a19660d6d813" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.216929] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-043de9ef-5509-4243-acb7-a19660d6d813" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.217014] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('043de9ef-5509-4243-acb7-a19660d6d813',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.626149] env[69920]: INFO networking_nsxv3.common.synchronization [None req-2f07ccfe-76fc-4d90-b454-9d8b129be294 None None] Enqueued Resource ID: e200e785-7029-447e-99dc-071625a3cbf7 with Priority: HIGHEST for action port [ 710.626149] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e200e785-7029-447e-99dc-071625a3cbf7 with Priority: HIGHEST for action port [ 710.626149] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-e200e785-7029-447e-99dc-071625a3cbf7 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.626149] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e200e785-7029-447e-99dc-071625a3cbf7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.626149] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e200e785-7029-447e-99dc-071625a3cbf7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.626149] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e200e785-7029-447e-99dc-071625a3cbf7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.626149] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e200e785-7029-447e-99dc-071625a3cbf7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.719585] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('361f5d4b-d775-40f2-9486-50f4511d4852',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.722980] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-361f5d4b-d775-40f2-9486-50f4511d4852 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.724824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.724824] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 043de9ef-5509-4243-acb7-a19660d6d813 with status ACTIVE [ 710.724824] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.724824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.724824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.724824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.724824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.724824] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.727450] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.727450] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.727450] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.727450] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.729018] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.729018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.729018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.729018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.729018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.729018] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 043de9ef-5509-4243-acb7-a19660d6d813 is going to be updated. [ 710.752545] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.752725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.752796] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.753281] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.753281] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.753413] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-043de9ef-5509-4243-acb7-a19660d6d813" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.893373] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd in Status: SUCCESS [ 710.893820] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.893820] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.894604] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.894604] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.894604] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.894604] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.895289] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.895289] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.895768] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.895993] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.089950] env[69920]: INFO networking_nsxv3.common.synchronization [req-dfd5e155-ee25-4f2c-bec7-8904915f25e2 req-47037a55-4bcf-49f3-a516-0c85f9938e5b tempest-ServerDiagnosticsTest-2111870055 tempest-ServerDiagnosticsTest-2111870055-project-member] Enqueued Resource ID: 8772ae4d-b3d8-4986-b291-e37049ac05b0 with Priority: HIGHEST for action security_group_members [ 711.090775] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8772ae4d-b3d8-4986-b291-e37049ac05b0 with Priority: HIGHEST for action security_group_members [ 711.091478] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8772ae4d-b3d8-4986-b291-e37049ac05b0 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.091744] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.091902] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.092213] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.092940] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.093196] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.093826] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.094157] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.094444] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.094642] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8772ae4d-b3d8-4986-b291-e37049ac05b0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.133951] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e200e785-7029-447e-99dc-071625a3cbf7 [ 711.133951] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.133951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.133951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.133951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.133951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.133951] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e200e785-7029-447e-99dc-071625a3cbf7 already deleted. [ 711.133951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e200e785-7029-447e-99dc-071625a3cbf7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.222578] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('361f5d4b-d775-40f2-9486-50f4511d4852',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.247710] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b in Status: SUCCESS [ 711.248079] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.400515] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-40f3bd9f-8637-49e8-92cd-03812c846cfd taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.400714] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.400783] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.401105] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.401277] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.401379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.401440] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.401701] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.401782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.401869] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.402018] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-40f3bd9f-8637-49e8-92cd-03812c846cfd taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.402108] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.402237] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.402488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.402706] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.402802] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.402862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.403015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.403298] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.403419] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.403667] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.425585] env[69920]: INFO networking_nsxv3.common.synchronization [None req-fab665af-7f4f-4422-9fd0-d1eb574b3d1a None None] Enqueued Resource ID: 2e59c01e-a00b-4afe-960b-62524dced656 with Priority: HIGHEST for action port [ 711.428030] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e59c01e-a00b-4afe-960b-62524dced656 with Priority: HIGHEST for action port [ 711.428030] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e59c01e-a00b-4afe-960b-62524dced656 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.428030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e59c01e-a00b-4afe-960b-62524dced656" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.428030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e59c01e-a00b-4afe-960b-62524dced656" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.428030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e59c01e-a00b-4afe-960b-62524dced656" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.428030] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e59c01e-a00b-4afe-960b-62524dced656',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.600251] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.600452] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.600839] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.600839] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.600839] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.601021] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.601130] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.601180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.601803] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.601803] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.601803] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8772ae4d-b3d8-4986-b291-e37049ac05b0 is going to be updated. [ 711.636215] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.636374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.636430] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.636650] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.636791] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.649398] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8772ae4d-b3d8-4986-b291-e37049ac05b0 in Status: IN_PROGRESS for 2s [ 711.725594] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.725735] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.725829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.726072] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.726166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.726267] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 361f5d4b-d775-40f2-9486-50f4511d4852 is going to be created. [ 711.757654] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.757654] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.757654] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.757654] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.757654] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.766710] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 361f5d4b-d775-40f2-9486-50f4511d4852 in Status: UNINITIALIZED for 2s [ 711.908454] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40f3bd9f-8637-49e8-92cd-03812c846cfd: rpc.has_security_group_logging(os_id): False [ 711.927204] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.927204] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.927204] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.927634] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.927634] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.927744] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.927840] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.927892] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.928625] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.928722] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.928922] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.929096] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.929096] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.929285] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.929405] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.929528] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.929621] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.929693] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.929873] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.929948] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.930060] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd is going to be created. [ 711.932016] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e59c01e-a00b-4afe-960b-62524dced656 [ 711.932202] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.932332] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.932665] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.932665] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.932665] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.933060] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e59c01e-a00b-4afe-960b-62524dced656 already deleted. [ 711.933060] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e59c01e-a00b-4afe-960b-62524dced656" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.012877] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.012877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.012877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.013130] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.013716] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.020016] env[69920]: INFO networking_nsxv3.common.synchronization [None req-79da0160-b30f-4784-89e3-9ad480ea7479 None None] Enqueued Resource ID: 69a86bd4-f7ae-4336-9fcc-3fe1ecb0ba4c with Priority: HIGHEST for action port [ 712.020610] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69a86bd4-f7ae-4336-9fcc-3fe1ecb0ba4c with Priority: HIGHEST for action port [ 712.021073] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-69a86bd4-f7ae-4336-9fcc-3fe1ecb0ba4c taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.021580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69a86bd4-f7ae-4336-9fcc-3fe1ecb0ba4c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.021580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69a86bd4-f7ae-4336-9fcc-3fe1ecb0ba4c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.021748] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69a86bd4-f7ae-4336-9fcc-3fe1ecb0ba4c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.021895] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69a86bd4-f7ae-4336-9fcc-3fe1ecb0ba4c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.038897] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd in Status: IN_PROGRESS for 2s [ 712.525589] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 69a86bd4-f7ae-4336-9fcc-3fe1ecb0ba4c [ 712.525821] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.525977] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.526060] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.527050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.527050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.527050] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:69a86bd4-f7ae-4336-9fcc-3fe1ecb0ba4c already deleted. [ 712.527050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69a86bd4-f7ae-4336-9fcc-3fe1ecb0ba4c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.662018] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8772ae4d-b3d8-4986-b291-e37049ac05b0 in Status: SUCCESS [ 713.662018] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8772ae4d-b3d8-4986-b291-e37049ac05b0 deletion is rescheduled due to dependency. [ 713.662018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.718259] env[69920]: INFO networking_nsxv3.common.synchronization [None req-54b268e8-9a79-4ba4-9698-41702580d6ed None None] Enqueued Resource ID: 74c07586-cf65-4a1d-99dd-aff57d955428 with Priority: HIGHEST for action port [ 713.718259] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c07586-cf65-4a1d-99dd-aff57d955428 with Priority: HIGHEST for action port [ 713.718259] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-74c07586-cf65-4a1d-99dd-aff57d955428 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.718259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74c07586-cf65-4a1d-99dd-aff57d955428" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.718259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74c07586-cf65-4a1d-99dd-aff57d955428" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.718259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74c07586-cf65-4a1d-99dd-aff57d955428" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.718259] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74c07586-cf65-4a1d-99dd-aff57d955428',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.779498] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 361f5d4b-d775-40f2-9486-50f4511d4852 in Status: SUCCESS [ 713.779498] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.779498] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.779937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.779937] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.779937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.780114] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.780114] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.780209] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.781654] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.781654] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('361f5d4b-d775-40f2-9486-50f4511d4852',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.055588] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd in Status: SUCCESS [ 714.055588] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.098646] env[69920]: INFO networking_nsxv3.common.synchronization [None req-6d6ca755-3ae6-4b24-869a-1f77e860a362 None None] Enqueued Resource ID: 316fc28e-8af3-401a-9102-8b77e9e1c8c1 with Priority: HIGHEST for action port [ 714.098646] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 316fc28e-8af3-401a-9102-8b77e9e1c8c1 with Priority: HIGHEST for action port [ 714.099260] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-316fc28e-8af3-401a-9102-8b77e9e1c8c1 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.099391] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-316fc28e-8af3-401a-9102-8b77e9e1c8c1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.099476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-316fc28e-8af3-401a-9102-8b77e9e1c8c1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.099851] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-316fc28e-8af3-401a-9102-8b77e9e1c8c1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.099934] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('316fc28e-8af3-401a-9102-8b77e9e1c8c1',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.225426] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74c07586-cf65-4a1d-99dd-aff57d955428 [ 714.225761] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.225911] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.225911] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.226135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.226229] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.226328] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74c07586-cf65-4a1d-99dd-aff57d955428 already deleted. [ 714.226410] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74c07586-cf65-4a1d-99dd-aff57d955428" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.287349] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('361f5d4b-d775-40f2-9486-50f4511d4852',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.604824] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 316fc28e-8af3-401a-9102-8b77e9e1c8c1 [ 714.604824] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.604824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.604824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.604824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.604824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.604824] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:316fc28e-8af3-401a-9102-8b77e9e1c8c1 already deleted. [ 714.604824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-316fc28e-8af3-401a-9102-8b77e9e1c8c1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.794319] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 361f5d4b-d775-40f2-9486-50f4511d4852: rpc.has_security_group_logging(os_id): False [ 714.815267] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.815267] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.815619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.815744] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.815952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.816235] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.816388] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.816541] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.816734] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.817057] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.817170] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 361f5d4b-d775-40f2-9486-50f4511d4852 is going to be created. [ 714.836682] env[69920]: INFO networking_nsxv3.common.synchronization [None req-b3cdf61b-9a7c-474d-9e7c-67c794f37cbb None None] Enqueued Resource ID: b841dc3e-ab54-4cf8-964c-78f9a5c85b2a with Priority: HIGHEST for action port [ 714.837482] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b841dc3e-ab54-4cf8-964c-78f9a5c85b2a with Priority: HIGHEST for action port [ 714.838592] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-b841dc3e-ab54-4cf8-964c-78f9a5c85b2a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.838963] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b841dc3e-ab54-4cf8-964c-78f9a5c85b2a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.839065] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b841dc3e-ab54-4cf8-964c-78f9a5c85b2a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.839400] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b841dc3e-ab54-4cf8-964c-78f9a5c85b2a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.839609] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b841dc3e-ab54-4cf8-964c-78f9a5c85b2a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.893351] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.893567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.894799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.894799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.894799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.910446] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 361f5d4b-d775-40f2-9486-50f4511d4852 in Status: IN_PROGRESS for 2s [ 715.341908] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b841dc3e-ab54-4cf8-964c-78f9a5c85b2a [ 715.342505] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.342683] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.342751] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.342957] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.343078] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.343181] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b841dc3e-ab54-4cf8-964c-78f9a5c85b2a already deleted. [ 715.343672] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b841dc3e-ab54-4cf8-964c-78f9a5c85b2a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.926101] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 361f5d4b-d775-40f2-9486-50f4511d4852 in Status: SUCCESS [ 716.926805] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.200679] env[69920]: INFO networking_nsxv3.common.synchronization [None req-77c1c764-96dc-481a-a460-9a80666db4f6 None None] Enqueued Resource ID: 1e7dad29-4a96-454b-8668-a7867d33d4b5 with Priority: HIGHEST for action port [ 717.203858] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e7dad29-4a96-454b-8668-a7867d33d4b5 with Priority: HIGHEST for action port [ 717.205461] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e7dad29-4a96-454b-8668-a7867d33d4b5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.205461] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e7dad29-4a96-454b-8668-a7867d33d4b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.205461] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e7dad29-4a96-454b-8668-a7867d33d4b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.205824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e7dad29-4a96-454b-8668-a7867d33d4b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.205824] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e7dad29-4a96-454b-8668-a7867d33d4b5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.712398] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e7dad29-4a96-454b-8668-a7867d33d4b5 [ 717.712579] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.712736] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.712801] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.713860] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.713860] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.713860] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e7dad29-4a96-454b-8668-a7867d33d4b5 already deleted. [ 717.713860] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e7dad29-4a96-454b-8668-a7867d33d4b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.537942] env[69920]: INFO networking_nsxv3.common.synchronization [req-814eb623-7e27-4088-b956-b1522e1ab3b6 req-5b0ca9dc-67b5-4203-a88e-c6257fe2ae5f tempest-ServerExternalEventsTest-2037619620 tempest-ServerExternalEventsTest-2037619620-project-member] Enqueued Resource ID: 0da8b432-7927-4b3d-81a7-f990d2563525 with Priority: HIGHEST for action security_group_members [ 718.538545] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0da8b432-7927-4b3d-81a7-f990d2563525 with Priority: HIGHEST for action security_group_members [ 718.538893] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0da8b432-7927-4b3d-81a7-f990d2563525 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.540862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.540972] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.541241] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.541438] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.541552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.541617] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.541788] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.541878] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.541987] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0da8b432-7927-4b3d-81a7-f990d2563525',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.047066] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.047066] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.047066] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.047066] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.047066] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.047066] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.047066] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.047066] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.047066] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.047066] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.047066] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0da8b432-7927-4b3d-81a7-f990d2563525 is going to be updated. [ 719.082779] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.082944] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.083065] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.083244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.083385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.092771] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0da8b432-7927-4b3d-81a7-f990d2563525 in Status: IN_PROGRESS for 2s [ 719.186548] env[69920]: INFO networking_nsxv3.common.synchronization [req-7fdd2f1a-9dca-4e70-9955-1bf0f49c364b req-7d4c43ab-ad63-4a0f-a67b-0ec116d4eaf0 tempest-ServersTestManualDisk-1798148514 tempest-ServersTestManualDisk-1798148514-project-member] Enqueued Resource ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 with Priority: HIGHEST for action security_group_members [ 719.187083] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 with Priority: HIGHEST for action security_group_members [ 719.187380] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e5cbff-80b3-432a-81ac-0bf4249c4679 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.187511] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.187579] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.187806] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.187957] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.188090] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.188154] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.189427] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.189427] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.189427] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e5cbff-80b3-432a-81ac-0bf4249c4679',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.691367] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.691661] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.691703] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.691909] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.692240] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.692324] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.692382] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.692482] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.692633] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.692712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.692803] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 already deleted. [ 719.692930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.819059] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-256 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.819059] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-256" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.819059] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-256" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.819059] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-256" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.819059] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.819059] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.819059] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.819948] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.820396] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.820817] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 719.821139] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 719.824036] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 719.824036] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 719.824036] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 719.824036] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 719.824036] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 719.855307] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 719.855307] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 719.855307] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 719.855307] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-256" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.855307] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-32ace01f-025d-4978-a510-c851c8daf246 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.855307] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-32ace01f-025d-4978-a510-c851c8daf246" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.855307] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-32ace01f-025d-4978-a510-c851c8daf246" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.856806] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-32ace01f-025d-4978-a510-c851c8daf246" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.856955] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32ace01f-025d-4978-a510-c851c8daf246',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.359751] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.360846] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.361039] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.361671] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.361861] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.362039] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 32ace01f-025d-4978-a510-c851c8daf246 not found, creating... [ 720.362333] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.362536] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.362659] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.362918] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.363080] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.364229] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.364806] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.364973] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.365236] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.365382] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.365805] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 32ace01f-025d-4978-a510-c851c8daf246 is going to be created. [ 720.389281] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.389525] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.389756] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.389977] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.390216] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.390721] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-32ace01f-025d-4978-a510-c851c8daf246" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.105122] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0da8b432-7927-4b3d-81a7-f990d2563525 in Status: SUCCESS [ 721.105457] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0da8b432-7927-4b3d-81a7-f990d2563525 deletion is rescheduled due to dependency. [ 721.105457] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.244377] env[69920]: INFO networking_nsxv3.common.synchronization [req-7fdd2f1a-9dca-4e70-9955-1bf0f49c364b req-16a2593d-9fbd-4fdb-aa18-111c2b81e198 service nova] Enqueued Resource ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 with Priority: HIGHEST for action security_group_rules [ 721.244377] env[69920]: INFO networking_nsxv3.common.synchronization [req-7fdd2f1a-9dca-4e70-9955-1bf0f49c364b req-16a2593d-9fbd-4fdb-aa18-111c2b81e198 service nova] Enqueued Resource ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 with Priority: HIGHEST for action security_group_members [ 721.244377] env[69920]: INFO networking_nsxv3.common.synchronization [req-7fdd2f1a-9dca-4e70-9955-1bf0f49c364b req-16a2593d-9fbd-4fdb-aa18-111c2b81e198 service nova] Enqueued Resource ID: 32ace01f-025d-4978-a510-c851c8daf246 with Priority: HIGHEST for action port [ 721.246104] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 with Priority: HIGHEST for action security_group_rules [ 721.247028] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 with Priority: HIGHEST for action security_group_members [ 721.247028] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ace01f-025d-4978-a510-c851c8daf246 with Priority: HIGHEST for action port [ 721.248293] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e5cbff-80b3-432a-81ac-0bf4249c4679 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.248410] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.248478] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.248703] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.248783] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e5cbff-80b3-432a-81ac-0bf4249c4679',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.249771] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e5cbff-80b3-432a-81ac-0bf4249c4679 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.249901] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.250374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.250668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.254662] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.254662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.254662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.254662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.254662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.254662] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e5cbff-80b3-432a-81ac-0bf4249c4679',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.254662] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-32ace01f-025d-4978-a510-c851c8daf246 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.254662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32ace01f-025d-4978-a510-c851c8daf246" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.254662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32ace01f-025d-4978-a510-c851c8daf246" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.254662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32ace01f-025d-4978-a510-c851c8daf246" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.254662] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32ace01f-025d-4978-a510-c851c8daf246',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.755157] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e5cbff-80b3-432a-81ac-0bf4249c4679 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.758019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.758019] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e5cbff-80b3-432a-81ac-0bf4249c4679',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.758019] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32ace01f-025d-4978-a510-c851c8daf246 with status ACTIVE [ 721.758019] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.758019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.758019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.758019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.758019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.758019] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.758945] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.759572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.760124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.761429] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.761429] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.762095] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.762095] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.762095] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.762095] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.762095] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32ace01f-025d-4978-a510-c851c8daf246 is going to be updated. [ 721.785480] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.785663] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.785769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.786075] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.786260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.786455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32ace01f-025d-4978-a510-c851c8daf246" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.970287] env[69920]: INFO networking_nsxv3.common.synchronization [req-22ecb8ac-2b09-4742-9bd8-d82dfe4f6c3d req-de971a72-4bf6-49bc-b85b-c26f95932dd7 tempest-DeleteServersTestJSON-1690074738 tempest-DeleteServersTestJSON-1690074738-project-member] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 721.971089] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 721.971483] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.971664] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.971876] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.972198] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.972625] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.972784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.972890] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.973098] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.973223] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.973345] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.264787] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e5cbff-80b3-432a-81ac-0bf4249c4679',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.477020] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.477202] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.477293] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.477494] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.477585] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.477783] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.477890] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.477937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.478102] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.478177] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.478266] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a already deleted. [ 722.478359] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.693024] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-105 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.693222] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.694455] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.694455] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.694455] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.694455] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.694965] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.694965] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.695062] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.695262] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 722.695375] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 722.695481] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 722.695588] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 722.695754] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 722.695885] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 722.696042] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 722.719023] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 722.719243] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 722.719465] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 722.719587] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.719908] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-85ea851a-ed88-452f-acd1-8e025fdeaeb0 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.720099] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-85ea851a-ed88-452f-acd1-8e025fdeaeb0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.720223] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-85ea851a-ed88-452f-acd1-8e025fdeaeb0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.720581] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-85ea851a-ed88-452f-acd1-8e025fdeaeb0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.720724] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85ea851a-ed88-452f-acd1-8e025fdeaeb0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.768407] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.768407] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.768407] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.768407] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.768407] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.768407] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 is going to be created. [ 722.796196] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.796346] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.796418] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.796644] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.796821] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.809399] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 in Status: UNINITIALIZED for 2s [ 723.223786] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.224277] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.224401] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.225049] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.225049] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.225249] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 85ea851a-ed88-452f-acd1-8e025fdeaeb0 not found, creating... [ 723.227082] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.227082] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.227082] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.227082] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.227082] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.227082] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.228438] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.228438] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.228438] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.228438] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.228438] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 85ea851a-ed88-452f-acd1-8e025fdeaeb0 is going to be created. [ 723.262864] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.266019] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.266019] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.266019] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.266019] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.266019] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-85ea851a-ed88-452f-acd1-8e025fdeaeb0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.430707] env[69920]: INFO networking_nsxv3.common.synchronization [req-22ecb8ac-2b09-4742-9bd8-d82dfe4f6c3d req-a49da0e7-3396-41bc-8322-85aa7c5f464c service nova] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_rules [ 724.431067] env[69920]: INFO networking_nsxv3.common.synchronization [req-22ecb8ac-2b09-4742-9bd8-d82dfe4f6c3d req-a49da0e7-3396-41bc-8322-85aa7c5f464c service nova] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 724.431067] env[69920]: INFO networking_nsxv3.common.synchronization [req-22ecb8ac-2b09-4742-9bd8-d82dfe4f6c3d req-a49da0e7-3396-41bc-8322-85aa7c5f464c service nova] Enqueued Resource ID: 85ea851a-ed88-452f-acd1-8e025fdeaeb0 with Priority: HIGHEST for action port [ 724.431290] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_rules [ 724.431413] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 724.431482] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85ea851a-ed88-452f-acd1-8e025fdeaeb0 with Priority: HIGHEST for action port [ 724.432488] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.432756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.433045] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.433376] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.433672] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.434658] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.438021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.438021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.438021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.438021] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.438021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.438021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.438021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.438021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.438021] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.439077] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-85ea851a-ed88-452f-acd1-8e025fdeaeb0 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.439139] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85ea851a-ed88-452f-acd1-8e025fdeaeb0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.439523] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85ea851a-ed88-452f-acd1-8e025fdeaeb0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.439523] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85ea851a-ed88-452f-acd1-8e025fdeaeb0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.439523] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85ea851a-ed88-452f-acd1-8e025fdeaeb0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.659035] env[69920]: INFO networking_nsxv3.common.synchronization [None req-b273e4f7-c177-49e3-b957-2541a7de3481 None None] Enqueued Resource ID: 724333fa-f7b0-4d06-b9aa-1c03eae72cb3 with Priority: HIGHEST for action port [ 724.659299] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 724333fa-f7b0-4d06-b9aa-1c03eae72cb3 with Priority: HIGHEST for action port [ 724.659890] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-724333fa-f7b0-4d06-b9aa-1c03eae72cb3 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.660017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-724333fa-f7b0-4d06-b9aa-1c03eae72cb3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.660150] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-724333fa-f7b0-4d06-b9aa-1c03eae72cb3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.664434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-724333fa-f7b0-4d06-b9aa-1c03eae72cb3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.664434] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('724333fa-f7b0-4d06-b9aa-1c03eae72cb3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.819869] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 in Status: SUCCESS [ 724.821633] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.821945] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.822120] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.822317] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.822504] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.822504] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.822669] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.822757] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.822868] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.823194] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06e5cbff-80b3-432a-81ac-0bf4249c4679',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.941568] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.941854] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.942135] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.944309] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 85ea851a-ed88-452f-acd1-8e025fdeaeb0 with status ACTIVE [ 724.944309] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.944309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.944309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.944483] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.944483] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.944648] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.944836] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.944836] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.944960] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.945031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.946204] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.946385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.946439] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.946629] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.946994] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.947127] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 85ea851a-ed88-452f-acd1-8e025fdeaeb0 is going to be updated. [ 724.983279] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.983432] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.983500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.983761] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.983907] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.984085] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85ea851a-ed88-452f-acd1-8e025fdeaeb0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.166401] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 724333fa-f7b0-4d06-b9aa-1c03eae72cb3 [ 725.167562] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.167562] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.167562] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.167562] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.167562] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.167562] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:724333fa-f7b0-4d06-b9aa-1c03eae72cb3 already deleted. [ 725.167562] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-724333fa-f7b0-4d06-b9aa-1c03eae72cb3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.325936] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06e5cbff-80b3-432a-81ac-0bf4249c4679',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.451955] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.830873] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06e5cbff-80b3-432a-81ac-0bf4249c4679: rpc.has_security_group_logging(os_id): False [ 725.860593] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.860593] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.860593] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.860593] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.860593] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.860593] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.861274] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.861274] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.861274] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.861274] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.861274] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 is going to be created. [ 725.938497] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.938497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.938497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.938781] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.939281] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.952720] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.953370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.953485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.953800] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.954070] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.954128] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be created. [ 725.957039] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 in Status: IN_PROGRESS for 2s [ 726.004074] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.004287] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.004391] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.004684] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.004905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.024236] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: UNINITIALIZED for 2s [ 726.927189] env[69920]: INFO networking_nsxv3.common.synchronization [req-2baa917f-d7d1-4510-a71c-29b6a2d7e699 req-6bb8b230-80a2-4a18-bdcb-0fdafd1fb0c3 tempest-ListImageFiltersTestJSON-1014675120 tempest-ListImageFiltersTestJSON-1014675120-project-member] Enqueued Resource ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f with Priority: HIGHEST for action security_group_members [ 726.927189] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f with Priority: HIGHEST for action security_group_members [ 726.927189] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.928817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.928817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.928817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.928817] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.928817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.928817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.928817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.928817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.930406] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.434010] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.434010] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.434010] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.434010] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.434010] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.434010] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.434010] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.434010] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.434010] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.434010] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.434010] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f already deleted. [ 727.434010] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.547960] env[69920]: INFO networking_nsxv3.common.synchronization [None req-a3893c6d-cc5f-48cb-973b-c943ac4dcfbf None None] Enqueued Resource ID: d83084f1-d898-4d70-8dbf-265fd46df9bf with Priority: HIGHEST for action port [ 727.547960] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d83084f1-d898-4d70-8dbf-265fd46df9bf with Priority: HIGHEST for action port [ 727.548372] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-d83084f1-d898-4d70-8dbf-265fd46df9bf taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.548497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d83084f1-d898-4d70-8dbf-265fd46df9bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.548570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d83084f1-d898-4d70-8dbf-265fd46df9bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.548822] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d83084f1-d898-4d70-8dbf-265fd46df9bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.548895] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d83084f1-d898-4d70-8dbf-265fd46df9bf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.558398] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-207 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.558639] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.558774] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.559091] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.559763] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.559970] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.560172] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.560461] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.560611] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.560832] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 727.561370] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 727.561654] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 727.561654] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 727.561854] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 727.561923] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 727.562041] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 727.584631] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 727.584631] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 727.584899] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 727.585150] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.585476] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-fbaaf58d-7762-4361-af98-ac03d24f2a05 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.585639] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-fbaaf58d-7762-4361-af98-ac03d24f2a05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.585763] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-fbaaf58d-7762-4361-af98-ac03d24f2a05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.587033] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-fbaaf58d-7762-4361-af98-ac03d24f2a05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.587033] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbaaf58d-7762-4361-af98-ac03d24f2a05',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.972464] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 in Status: SUCCESS [ 727.973278] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.040898] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: SUCCESS [ 728.041189] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.041373] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.041588] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.041831] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.042014] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.042099] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.042598] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.042598] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.042598] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.042598] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.052839] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d83084f1-d898-4d70-8dbf-265fd46df9bf [ 728.053364] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.053693] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.053693] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.053890] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.053992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.054119] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d83084f1-d898-4d70-8dbf-265fd46df9bf already deleted. [ 728.054262] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d83084f1-d898-4d70-8dbf-265fd46df9bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.085452] env[69920]: INFO networking_nsxv3.common.synchronization [None req-02d1a4aa-1722-4f33-a8f8-74dc57c9809f None None] Enqueued Resource ID: c0f03fa4-7e0e-4ca5-98d0-23e54abfd5c4 with Priority: HIGHEST for action port [ 728.086644] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0f03fa4-7e0e-4ca5-98d0-23e54abfd5c4 with Priority: HIGHEST for action port [ 728.088585] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.089010] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.089305] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.090057] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.090057] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.090463] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port fbaaf58d-7762-4361-af98-ac03d24f2a05 not found, creating... [ 728.090936] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.091317] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.091890] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.092291] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.092530] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.092892] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.093202] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.093402] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.094063] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.095036] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.095036] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: fbaaf58d-7762-4361-af98-ac03d24f2a05 is going to be created. [ 728.096807] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0f03fa4-7e0e-4ca5-98d0-23e54abfd5c4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.097530] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0f03fa4-7e0e-4ca5-98d0-23e54abfd5c4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.097530] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0f03fa4-7e0e-4ca5-98d0-23e54abfd5c4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.097829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0f03fa4-7e0e-4ca5-98d0-23e54abfd5c4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.097984] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0f03fa4-7e0e-4ca5-98d0-23e54abfd5c4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.125368] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.125596] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.125821] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.126057] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.126280] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.126510] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-fbaaf58d-7762-4361-af98-ac03d24f2a05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.545528] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.545680] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.545754] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.545992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.546167] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.546292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.546357] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.546516] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.546607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.546723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.546840] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.546952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.547032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.547174] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.547313] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.547420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.547466] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.547627] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.547696] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.547775] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.547866] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.604430] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c0f03fa4-7e0e-4ca5-98d0-23e54abfd5c4 [ 728.604692] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.604841] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.604910] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.605168] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.605276] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.605341] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c0f03fa4-7e0e-4ca5-98d0-23e54abfd5c4 already deleted. [ 728.605423] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0f03fa4-7e0e-4ca5-98d0-23e54abfd5c4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.909112] env[69920]: INFO networking_nsxv3.common.synchronization [req-2baa917f-d7d1-4510-a71c-29b6a2d7e699 req-b573fcc6-8022-436f-9d95-2e338854bc8d service nova] Enqueued Resource ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f with Priority: HIGHEST for action security_group_rules [ 728.909407] env[69920]: INFO networking_nsxv3.common.synchronization [req-2baa917f-d7d1-4510-a71c-29b6a2d7e699 req-b573fcc6-8022-436f-9d95-2e338854bc8d service nova] Enqueued Resource ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f with Priority: HIGHEST for action security_group_members [ 728.909631] env[69920]: INFO networking_nsxv3.common.synchronization [req-2baa917f-d7d1-4510-a71c-29b6a2d7e699 req-b573fcc6-8022-436f-9d95-2e338854bc8d service nova] Enqueued Resource ID: fbaaf58d-7762-4361-af98-ac03d24f2a05 with Priority: HIGHEST for action port [ 728.914884] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f with Priority: HIGHEST for action security_group_rules [ 728.914884] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f with Priority: HIGHEST for action security_group_members [ 728.914884] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbaaf58d-7762-4361-af98-ac03d24f2a05 with Priority: HIGHEST for action port [ 728.915403] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.915403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.915525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.915735] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.915819] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.917246] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.917380] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.917457] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.917639] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.917802] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.917925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.917999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.918135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.918265] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.918324] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.919180] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbaaf58d-7762-4361-af98-ac03d24f2a05 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.919302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbaaf58d-7762-4361-af98-ac03d24f2a05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.919374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbaaf58d-7762-4361-af98-ac03d24f2a05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.919530] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbaaf58d-7762-4361-af98-ac03d24f2a05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.920360] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbaaf58d-7762-4361-af98-ac03d24f2a05',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.056292] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fdaff9b-63be-497c-8622-3160e739856a: rpc.has_security_group_logging(os_id): False [ 729.076293] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.076479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.076479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.077535] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.077535] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.077535] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.077535] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.077535] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.077535] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.077535] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.077999] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.077999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.077999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.079808] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.079917] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.080158] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.080246] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.080311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.080470] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.080550] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.080668] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be created. [ 729.145409] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.145409] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.145409] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.145409] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.145409] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.155584] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: IN_PROGRESS for 2s [ 729.224293] env[69920]: INFO networking_nsxv3.common.synchronization [req-a8f51541-4798-4b80-84a3-7e4417867cf0 req-0834d024-a5b5-4b24-8d71-fcf1cb60d41b tempest-FloatingIPsAssociationNegativeTestJSON-1933372996 tempest-FloatingIPsAssociationNegativeTestJSON-1933372996-project-member] Enqueued Resource ID: f8b9ce1a-2b8e-4a65-b28c-620181c45204 with Priority: HIGHEST for action security_group_members [ 729.224911] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8b9ce1a-2b8e-4a65-b28c-620181c45204 with Priority: HIGHEST for action security_group_members [ 729.225364] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8b9ce1a-2b8e-4a65-b28c-620181c45204 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.225463] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.225463] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.225741] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.225914] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.226050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.226954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.227225] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.227341] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.227624] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8b9ce1a-2b8e-4a65-b28c-620181c45204',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.421180] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.422324] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.422467] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.422642] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fbaaf58d-7762-4361-af98-ac03d24f2a05 with status ACTIVE [ 729.422828] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.422952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.423036] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.423286] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.423463] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.423635] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.423767] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.423767] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.423992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.423992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.428026] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.428026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.428026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.428026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.428026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.428026] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fbaaf58d-7762-4361-af98-ac03d24f2a05 is going to be updated. [ 729.453724] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.453917] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.454036] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.454533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.454612] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.454824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbaaf58d-7762-4361-af98-ac03d24f2a05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.517467] env[69920]: INFO networking_nsxv3.common.synchronization [None req-10fcbd1c-2019-4f2b-8c32-706bdef86609 None None] Enqueued Resource ID: 5a5daddb-d087-4ee8-a71e-a374e7802102 with Priority: HIGHEST for action port [ 729.517467] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a5daddb-d087-4ee8-a71e-a374e7802102 with Priority: HIGHEST for action port [ 729.518144] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a5daddb-d087-4ee8-a71e-a374e7802102 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.518897] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a5daddb-d087-4ee8-a71e-a374e7802102" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.519108] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a5daddb-d087-4ee8-a71e-a374e7802102" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.519406] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a5daddb-d087-4ee8-a71e-a374e7802102" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.519490] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a5daddb-d087-4ee8-a71e-a374e7802102',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.730313] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.730767] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.730856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.731178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.731337] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.731608] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.731982] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.732124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.732323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.732431] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.732528] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8b9ce1a-2b8e-4a65-b28c-620181c45204 is going to be updated. [ 729.757022] env[69920]: INFO networking_nsxv3.common.synchronization [None req-2d6ae000-c35a-4825-a64b-68d65a423c88 None None] Enqueued Resource ID: 15bef0ad-bda1-442b-926f-50a60b34ffdc with Priority: HIGHEST for action port [ 729.757344] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15bef0ad-bda1-442b-926f-50a60b34ffdc with Priority: HIGHEST for action port [ 729.758654] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-15bef0ad-bda1-442b-926f-50a60b34ffdc taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.758856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15bef0ad-bda1-442b-926f-50a60b34ffdc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.759180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15bef0ad-bda1-442b-926f-50a60b34ffdc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.759632] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15bef0ad-bda1-442b-926f-50a60b34ffdc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.759771] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15bef0ad-bda1-442b-926f-50a60b34ffdc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.763813] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.763813] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.763813] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.763813] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.764229] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.774865] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8b9ce1a-2b8e-4a65-b28c-620181c45204 in Status: IN_PROGRESS for 2s [ 729.928128] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.022137] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a5daddb-d087-4ee8-a71e-a374e7802102 [ 730.022437] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.023585] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.023585] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.023585] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.023585] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.023585] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a5daddb-d087-4ee8-a71e-a374e7802102 already deleted. [ 730.023585] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a5daddb-d087-4ee8-a71e-a374e7802102" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.261395] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15bef0ad-bda1-442b-926f-50a60b34ffdc [ 730.261760] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.261842] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.261934] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.262229] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.262325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.262425] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15bef0ad-bda1-442b-926f-50a60b34ffdc already deleted. [ 730.262547] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15bef0ad-bda1-442b-926f-50a60b34ffdc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.431131] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.431304] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.431365] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.431596] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.431695] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.431795] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f is going to be created. [ 730.461019] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.461184] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.461230] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.461509] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.461627] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.478160] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f in Status: UNINITIALIZED for 2s [ 730.557821] env[69920]: INFO networking_nsxv3.common.synchronization [None req-45f4ed66-9beb-424e-869d-42b6a1d8e402 tempest-AttachInterfacesTestJSON-901858583 tempest-AttachInterfacesTestJSON-901858583-project-member] Enqueued Resource ID: 82051f94-9eeb-470d-aa42-9e827049069f with Priority: HIGHEST for action security_group_rules [ 730.558493] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82051f94-9eeb-470d-aa42-9e827049069f with Priority: HIGHEST for action security_group_rules [ 730.558845] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82051f94-9eeb-470d-aa42-9e827049069f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.558984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.559427] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.559731] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.563544] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82051f94-9eeb-470d-aa42-9e827049069f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.677619] env[69920]: INFO networking_nsxv3.common.synchronization [None req-6a9d41ca-71c5-49ad-b3f1-14f28840dd86 tempest-AttachInterfacesTestJSON-901858583 tempest-AttachInterfacesTestJSON-901858583-project-member] Enqueued Resource ID: 82051f94-9eeb-470d-aa42-9e827049069f with Priority: HIGHEST for action security_group_rules [ 730.681180] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82051f94-9eeb-470d-aa42-9e827049069f with Priority: HIGHEST for action security_group_rules [ 730.682505] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82051f94-9eeb-470d-aa42-9e827049069f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.684043] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.091141] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.091396] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.091488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.091827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.092010] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.092158] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82051f94-9eeb-470d-aa42-9e827049069f already deleted. [ 731.092290] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.092493] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.092743] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.092791] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82051f94-9eeb-470d-aa42-9e827049069f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.170020] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: SUCCESS [ 731.170310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.613436] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.613877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.613877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.614785] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.615381] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.615381] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82051f94-9eeb-470d-aa42-9e827049069f already deleted. [ 731.615381] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.649547] env[69920]: INFO networking_nsxv3.common.synchronization [None req-7f8b1d17-ab55-4c2d-bc1a-34456b8dbe36 tempest-AttachVolumeNegativeTest-700673554 tempest-AttachVolumeNegativeTest-700673554-project-member] Enqueued Resource ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 with Priority: HIGHEST for action security_group_rules [ 731.650328] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 with Priority: HIGHEST for action security_group_rules [ 731.650819] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-394b8a58-53d4-4ddb-998c-b2810a22cd53 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.650983] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.651065] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.651373] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.651461] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('394b8a58-53d4-4ddb-998c-b2810a22cd53',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.788126] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8b9ce1a-2b8e-4a65-b28c-620181c45204 in Status: SUCCESS [ 731.788196] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8b9ce1a-2b8e-4a65-b28c-620181c45204 deletion is rescheduled due to dependency. [ 731.788595] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.801915] env[69920]: INFO networking_nsxv3.common.synchronization [None req-f0e39744-e018-4ac6-ae9d-9d825ab8c6c6 tempest-AttachVolumeNegativeTest-700673554 tempest-AttachVolumeNegativeTest-700673554-project-member] Enqueued Resource ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 with Priority: HIGHEST for action security_group_rules [ 731.802469] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 with Priority: HIGHEST for action security_group_rules [ 731.802780] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-394b8a58-53d4-4ddb-998c-b2810a22cd53 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.804151] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.174049] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.174502] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.174587] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.174812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.175094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.175201] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 already deleted. [ 732.175313] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.175495] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.175730] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.175868] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('394b8a58-53d4-4ddb-998c-b2810a22cd53',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.281513] env[69920]: INFO networking_nsxv3.common.synchronization [None req-68241931-fde4-41ea-b846-b799424a0ed6 None None] Enqueued Resource ID: a617a8fa-a850-4dc6-a92a-1293647852f0 with Priority: HIGHEST for action port [ 732.282075] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a617a8fa-a850-4dc6-a92a-1293647852f0 with Priority: HIGHEST for action port [ 732.282338] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-a617a8fa-a850-4dc6-a92a-1293647852f0 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.282772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a617a8fa-a850-4dc6-a92a-1293647852f0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.282772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a617a8fa-a850-4dc6-a92a-1293647852f0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.282772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a617a8fa-a850-4dc6-a92a-1293647852f0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.282969] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a617a8fa-a850-4dc6-a92a-1293647852f0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.489196] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f in Status: SUCCESS [ 732.489196] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.489313] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.489852] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.489953] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.490131] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.490203] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.490441] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.490596] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.490759] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.490898] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.699471] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.699471] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.699786] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.699786] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.700075] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.700296] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 already deleted. [ 732.700461] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.785634] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a617a8fa-a850-4dc6-a92a-1293647852f0 [ 732.785916] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.786116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.786195] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.786448] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.786543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.786656] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a617a8fa-a850-4dc6-a92a-1293647852f0 already deleted. [ 732.786743] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a617a8fa-a850-4dc6-a92a-1293647852f0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.993843] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.994113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.994215] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.994526] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.994787] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.994926] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.995030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.995233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.995351] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.995494] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.995768] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.995879] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.995935] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.996133] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.996307] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.996415] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.996485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.996684] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.996792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.996930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.997077] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.499432] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f: rpc.has_security_group_logging(os_id): False [ 733.524298] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.525646] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.525646] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.525646] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.525646] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.525646] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.525646] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.525646] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.525646] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.525646] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.526453] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.526453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.526453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.526453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.526453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.526882] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.526882] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.526882] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.526882] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.527378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.527659] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f is going to be created. [ 733.610031] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.610349] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.610349] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.610630] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.610749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.624122] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f in Status: IN_PROGRESS for 2s [ 734.131254] env[69920]: INFO networking_nsxv3.common.synchronization [req-79168f04-755b-436c-b335-23e7fa566ab2 req-681e87bd-0009-49c9-9246-9023ffec2aaa tempest-ServerRescueTestJSON-1075581336 tempest-ServerRescueTestJSON-1075581336-project-member] Enqueued Resource ID: a6054485-180a-4f29-a65a-3151187db51e with Priority: HIGHEST for action security_group_members [ 734.131811] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6054485-180a-4f29-a65a-3151187db51e with Priority: HIGHEST for action security_group_members [ 734.132349] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6054485-180a-4f29-a65a-3151187db51e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.132509] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.132619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.133340] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.133340] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.133340] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.133549] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.133586] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.133664] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.133775] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6054485-180a-4f29-a65a-3151187db51e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.488430] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-757 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.488667] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-757" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.488775] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-757" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.489462] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-757" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.489772] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.489957] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.490090] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.490330] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.490479] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.490694] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 734.490813] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 734.490922] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 734.491159] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 734.491302] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 734.491414] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 734.491552] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 734.512453] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 734.512624] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 734.512744] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 734.512959] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-757" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.513441] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-f02a1745-61d5-4414-88fe-680d9e7bba72 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.513617] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-f02a1745-61d5-4414-88fe-680d9e7bba72" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.513803] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-f02a1745-61d5-4414-88fe-680d9e7bba72" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.514189] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-f02a1745-61d5-4414-88fe-680d9e7bba72" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.514345] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f02a1745-61d5-4414-88fe-680d9e7bba72',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.637668] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.637668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.637668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.637668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.637668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.637668] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.637668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.640119] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.640413] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.641037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.641230] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6054485-180a-4f29-a65a-3151187db51e already deleted. [ 734.641366] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.018168] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.018168] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.018168] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.018168] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.018168] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.021891] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port f02a1745-61d5-4414-88fe-680d9e7bba72 not found, creating... [ 735.021891] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.021891] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.021891] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.021891] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.021891] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.021891] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.021891] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.021891] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.021891] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.022451] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.022451] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: f02a1745-61d5-4414-88fe-680d9e7bba72 is going to be created. [ 735.041543] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.041804] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.041939] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.042993] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.042993] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.042993] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-f02a1745-61d5-4414-88fe-680d9e7bba72" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.640477] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f in Status: SUCCESS [ 735.640477] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.789618] env[69920]: INFO networking_nsxv3.common.synchronization [req-79168f04-755b-436c-b335-23e7fa566ab2 req-083c33f8-e056-4499-9394-62776b01963a service nova] Enqueued Resource ID: a6054485-180a-4f29-a65a-3151187db51e with Priority: HIGHEST for action security_group_rules [ 735.790966] env[69920]: INFO networking_nsxv3.common.synchronization [req-79168f04-755b-436c-b335-23e7fa566ab2 req-083c33f8-e056-4499-9394-62776b01963a service nova] Enqueued Resource ID: a6054485-180a-4f29-a65a-3151187db51e with Priority: HIGHEST for action security_group_members [ 735.790966] env[69920]: INFO networking_nsxv3.common.synchronization [req-79168f04-755b-436c-b335-23e7fa566ab2 req-083c33f8-e056-4499-9394-62776b01963a service nova] Enqueued Resource ID: f02a1745-61d5-4414-88fe-680d9e7bba72 with Priority: HIGHEST for action port [ 735.790966] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6054485-180a-4f29-a65a-3151187db51e with Priority: HIGHEST for action security_group_rules [ 735.790966] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6054485-180a-4f29-a65a-3151187db51e with Priority: HIGHEST for action security_group_members [ 735.790966] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f02a1745-61d5-4414-88fe-680d9e7bba72 with Priority: HIGHEST for action port [ 735.790966] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6054485-180a-4f29-a65a-3151187db51e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.791956] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.791956] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.792241] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.792307] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6054485-180a-4f29-a65a-3151187db51e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.793158] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6054485-180a-4f29-a65a-3151187db51e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.793253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.793310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.793460] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.793603] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.793697] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.793765] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.793900] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.793990] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.794094] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6054485-180a-4f29-a65a-3151187db51e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.794879] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-f02a1745-61d5-4414-88fe-680d9e7bba72 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.795087] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f02a1745-61d5-4414-88fe-680d9e7bba72" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.795087] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f02a1745-61d5-4414-88fe-680d9e7bba72" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.795527] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f02a1745-61d5-4414-88fe-680d9e7bba72" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.795527] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f02a1745-61d5-4414-88fe-680d9e7bba72',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.297144] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6054485-180a-4f29-a65a-3151187db51e taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.297349] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.299351] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6054485-180a-4f29-a65a-3151187db51e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.299351] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f02a1745-61d5-4414-88fe-680d9e7bba72 with status ACTIVE [ 736.299351] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.299607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.299607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.299783] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.299871] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.300146] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.300263] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.300263] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.300438] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.300575] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.300842] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.300954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.301343] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.301615] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.301779] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.302020] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f02a1745-61d5-4414-88fe-680d9e7bba72 is going to be updated. [ 736.330274] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.330274] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.330274] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.330274] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.330274] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.330274] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f02a1745-61d5-4414-88fe-680d9e7bba72" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.805175] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6054485-180a-4f29-a65a-3151187db51e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.309607] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.309607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.309607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.309607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.309607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.309607] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6054485-180a-4f29-a65a-3151187db51e is going to be created. [ 737.338450] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.338450] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.338450] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.339038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.339143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.365981] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6054485-180a-4f29-a65a-3151187db51e in Status: UNINITIALIZED for 2s [ 737.606517] env[69920]: INFO networking_nsxv3.common.synchronization [req-4b83d762-4cb8-45ee-97f3-22503fb14b61 req-b64fcfa3-239c-452a-9d56-082e077e3193 tempest-DeleteServersTestJSON-1690074738 tempest-DeleteServersTestJSON-1690074738-project-member] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 737.607132] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 737.607456] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.607584] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.607663] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.607859] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.608014] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.608283] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.608355] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.609289] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.609289] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.609289] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.654708] env[69920]: INFO networking_nsxv3.common.synchronization [req-6879b171-1fb9-4fa7-8796-fb4e2d410e32 req-44df9b2b-c636-4562-9576-3bfa2e041704 tempest-ImagesOneServerTestJSON-280648197 tempest-ImagesOneServerTestJSON-280648197-project-member] Enqueued Resource ID: 156af133-c5cb-4af5-87be-b21d4422308a with Priority: HIGHEST for action security_group_members [ 737.655524] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156af133-c5cb-4af5-87be-b21d4422308a with Priority: HIGHEST for action security_group_members [ 737.656180] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-156af133-c5cb-4af5-87be-b21d4422308a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.656180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.657696] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.658136] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.658806] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.658978] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.659154] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.659915] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.660080] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.660219] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('156af133-c5cb-4af5-87be-b21d4422308a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.994893] env[69920]: INFO networking_nsxv3.common.synchronization [req-4f6c4883-a10d-4dae-bd1f-63bf4816d4b2 req-9d3471d9-deeb-4995-9174-c1612de36a5e tempest-ImagesTestJSON-210893687 tempest-ImagesTestJSON-210893687-project-member] Enqueued Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 737.999866] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 737.999866] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.999866] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.999866] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.999866] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.999866] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.999866] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.999866] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.999866] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.999866] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.999866] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.113061] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.113061] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.113061] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.113061] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.113061] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.113061] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.113061] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.113061] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.113061] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.113061] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.113703] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be updated. [ 738.151514] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.151514] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.151514] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.151514] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.151514] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.164171] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: IN_PROGRESS for 2s [ 738.165299] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.165299] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.165299] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.165299] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.165299] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.165569] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.165569] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.165658] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.165880] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.165963] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.166264] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156af133-c5cb-4af5-87be-b21d4422308a is going to be updated. [ 738.200274] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.200502] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.200502] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.200742] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.200893] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.223502] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156af133-c5cb-4af5-87be-b21d4422308a in Status: IN_PROGRESS for 2s [ 738.500937] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.501176] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.501252] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.501463] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.501554] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.501789] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.501903] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.501985] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.502159] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.502237] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.502324] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 is going to be updated. [ 738.534359] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.534509] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.534579] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.534804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.534949] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.547844] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: IN_PROGRESS for 2s [ 739.315434] env[69920]: INFO networking_nsxv3.common.synchronization [req-b02a913c-18df-48d1-8fcd-b9e6f3fba380 req-f213ee84-42c7-456b-b835-0f8f38fc8a27 tempest-ServerAddressesTestJSON-1437605563 tempest-ServerAddressesTestJSON-1437605563-project-member] Enqueued Resource ID: fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 with Priority: HIGHEST for action security_group_members [ 739.315434] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 with Priority: HIGHEST for action security_group_members [ 739.315434] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.315434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.315434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.315434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.315434] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.315434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.315434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.315434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.315434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.315434] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.378479] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6054485-180a-4f29-a65a-3151187db51e in Status: SUCCESS [ 739.378479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.378479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.378479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.378479] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.378479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.378479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.378479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.378479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.378479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.379466] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6054485-180a-4f29-a65a-3151187db51e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.687431] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-786 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.687693] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-786" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.687755] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-786" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.688611] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-786" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.688611] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.688611] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.688834] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.688876] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.695016] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.695016] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 739.695146] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 739.695266] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 739.695375] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 739.695661] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 739.695661] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 739.695740] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 739.730134] env[69920]: INFO networking_nsxv3.common.synchronization [None req-028914cf-73e6-4237-9047-fdee53b75408 None None] Enqueued Resource ID: a1ccd92e-ff2f-4f0e-91d7-d8563e61df86 with Priority: HIGHEST for action port [ 739.731916] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1ccd92e-ff2f-4f0e-91d7-d8563e61df86 with Priority: HIGHEST for action port [ 739.731916] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1ccd92e-ff2f-4f0e-91d7-d8563e61df86 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.731916] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1ccd92e-ff2f-4f0e-91d7-d8563e61df86" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.731916] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1ccd92e-ff2f-4f0e-91d7-d8563e61df86" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.732691] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1ccd92e-ff2f-4f0e-91d7-d8563e61df86" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.732691] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1ccd92e-ff2f-4f0e-91d7-d8563e61df86',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.756924] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 739.756924] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.061 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 739.756924] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 739.757161] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-786" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.760981] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-fef5adda-8c0b-4f55-8d26-a44ba11e36ce taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.760981] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-fef5adda-8c0b-4f55-8d26-a44ba11e36ce" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.760981] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-fef5adda-8c0b-4f55-8d26-a44ba11e36ce" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.760981] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-fef5adda-8c0b-4f55-8d26-a44ba11e36ce" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.760981] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fef5adda-8c0b-4f55-8d26-a44ba11e36ce',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.817635] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.818217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.818459] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.818844] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.819092] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.819496] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.819721] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.819917] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.820150] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.820291] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.820434] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 already deleted. [ 739.820561] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.885266] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6054485-180a-4f29-a65a-3151187db51e taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.885434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.885496] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.885757] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.885869] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.885976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.886056] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.886211] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.886301] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.886390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.886536] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6054485-180a-4f29-a65a-3151187db51e taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.886631] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.886687] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.886830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.887023] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.887114] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.887114] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.887255] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.887335] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.887425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.887514] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6054485-180a-4f29-a65a-3151187db51e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.176995] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: SUCCESS [ 740.176995] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a deletion is rescheduled due to dependency. [ 740.176995] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.237105] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 156af133-c5cb-4af5-87be-b21d4422308a in Status: SUCCESS [ 740.240292] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 156af133-c5cb-4af5-87be-b21d4422308a deletion is rescheduled due to dependency. [ 740.240292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-156af133-c5cb-4af5-87be-b21d4422308a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.240292] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1ccd92e-ff2f-4f0e-91d7-d8563e61df86 [ 740.240292] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.240292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.240292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.240292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.240292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.240292] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1ccd92e-ff2f-4f0e-91d7-d8563e61df86 already deleted. [ 740.240292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1ccd92e-ff2f-4f0e-91d7-d8563e61df86" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.267111] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.267359] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.267485] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.267782] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.268037] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.268203] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port fef5adda-8c0b-4f55-8d26-a44ba11e36ce not found, creating... [ 740.268485] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.268655] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.268772] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.269015] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.269158] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.269534] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.269703] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.269821] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.274151] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.274399] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.274567] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: fef5adda-8c0b-4f55-8d26-a44ba11e36ce is going to be created. [ 740.305070] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.305070] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.305070] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.305070] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.305070] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.305517] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-fef5adda-8c0b-4f55-8d26-a44ba11e36ce" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.391922] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6054485-180a-4f29-a65a-3151187db51e: rpc.has_security_group_logging(os_id): False [ 740.411023] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.411232] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.411280] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.411469] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.411567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.411759] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.411891] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.411964] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.412190] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.412275] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.412479] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.412576] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.412639] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.412792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.412872] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.413124] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.413227] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.413302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.413452] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.413529] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.413616] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6054485-180a-4f29-a65a-3151187db51e is going to be created. [ 740.499501] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.499708] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.499777] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.499948] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.500166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.513401] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6054485-180a-4f29-a65a-3151187db51e in Status: IN_PROGRESS for 2s [ 740.556783] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: SUCCESS [ 740.557081] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 deletion is rescheduled due to dependency. [ 740.557081] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.029641] env[69920]: INFO networking_nsxv3.common.synchronization [req-b02a913c-18df-48d1-8fcd-b9e6f3fba380 req-2fceef17-0171-46e5-9aff-f9c2d08f0ff8 service nova] Enqueued Resource ID: fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 with Priority: HIGHEST for action security_group_rules [ 741.029902] env[69920]: INFO networking_nsxv3.common.synchronization [req-b02a913c-18df-48d1-8fcd-b9e6f3fba380 req-2fceef17-0171-46e5-9aff-f9c2d08f0ff8 service nova] Enqueued Resource ID: fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 with Priority: HIGHEST for action security_group_members [ 741.030088] env[69920]: INFO networking_nsxv3.common.synchronization [req-b02a913c-18df-48d1-8fcd-b9e6f3fba380 req-2fceef17-0171-46e5-9aff-f9c2d08f0ff8 service nova] Enqueued Resource ID: fef5adda-8c0b-4f55-8d26-a44ba11e36ce with Priority: HIGHEST for action port [ 741.030202] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 with Priority: HIGHEST for action security_group_rules [ 741.030338] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 with Priority: HIGHEST for action security_group_members [ 741.030431] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fef5adda-8c0b-4f55-8d26-a44ba11e36ce with Priority: HIGHEST for action port [ 741.031047] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.032640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.032640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.032954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.033245] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.034940] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.035150] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.035150] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.035404] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.035522] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.035649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.035746] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.035961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.036124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.036176] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.039636] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-fef5adda-8c0b-4f55-8d26-a44ba11e36ce taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.039636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fef5adda-8c0b-4f55-8d26-a44ba11e36ce" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.039636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fef5adda-8c0b-4f55-8d26-a44ba11e36ce" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.039636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fef5adda-8c0b-4f55-8d26-a44ba11e36ce" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.039636] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fef5adda-8c0b-4f55-8d26-a44ba11e36ce',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.564749] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.564749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.564749] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.564749] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fef5adda-8c0b-4f55-8d26-a44ba11e36ce with status ACTIVE [ 741.564749] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.564749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.564749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.564749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.564749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.564749] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.564749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.564749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.564749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.564749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.565749] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.565749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.565749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.565749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.565749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.565749] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fef5adda-8c0b-4f55-8d26-a44ba11e36ce is going to be updated. [ 741.574856] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.574856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.574856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.574856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.574856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.574856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fef5adda-8c0b-4f55-8d26-a44ba11e36ce" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.757944] env[69920]: INFO networking_nsxv3.common.synchronization [None req-a85e3918-d6a8-4f00-9026-6ebfd8d7a240 None None] Enqueued Resource ID: a229c557-696c-487a-a297-7f5746c76b02 with Priority: HIGHEST for action port [ 741.758771] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a229c557-696c-487a-a297-7f5746c76b02 with Priority: HIGHEST for action port [ 741.758771] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-a229c557-696c-487a-a297-7f5746c76b02 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.758881] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a229c557-696c-487a-a297-7f5746c76b02" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.758950] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a229c557-696c-487a-a297-7f5746c76b02" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.759340] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a229c557-696c-487a-a297-7f5746c76b02" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.759464] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a229c557-696c-487a-a297-7f5746c76b02',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.048578] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.096539] env[69920]: INFO networking_nsxv3.common.synchronization [req-0c5b7f4e-d3e2-402e-a1a2-b95233343c29 req-6c73e7c8-e676-468f-9be2-8a50e5c3d3d0 tempest-ListServersNegativeTestJSON-2142759027 tempest-ListServersNegativeTestJSON-2142759027-project-member] Enqueued Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_members [ 742.098576] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_members [ 742.098934] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4fb140-8d8f-45fe-9d42-7405286ea87b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.099072] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.099162] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.099373] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.099527] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.099627] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.099690] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.099835] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.099920] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.100025] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.262032] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a229c557-696c-487a-a297-7f5746c76b02 [ 742.262358] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.262563] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.262679] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.262979] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.263098] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.263198] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a229c557-696c-487a-a297-7f5746c76b02 already deleted. [ 742.263282] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a229c557-696c-487a-a297-7f5746c76b02" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.529947] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6054485-180a-4f29-a65a-3151187db51e in Status: SUCCESS [ 742.529947] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.552615] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.552758] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.554696] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.554696] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.554696] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.554696] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 is going to be created. [ 742.575875] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.576248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.576248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.576360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.576508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.589675] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 in Status: UNINITIALIZED for 2s [ 742.603185] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.946764] env[69920]: INFO networking_nsxv3.common.synchronization [req-9c05e90d-2745-446b-85e0-65401f3e90c2 req-6111b825-96d3-4169-8125-b90907edd659 tempest-ListServersNegativeTestJSON-2142759027 tempest-ListServersNegativeTestJSON-2142759027-project-member] Enqueued Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_members [ 742.947298] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGHEST for action security_group_members [ 742.947720] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b4fb140-8d8f-45fe-9d42-7405286ea87b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.947811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.105313] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.298031] env[69920]: INFO networking_nsxv3.common.synchronization [req-db62ef13-d828-4299-a55c-038b49f2de70 req-ab47835b-9c45-4f6b-aa97-6ec6ac356b53 tempest-ListImageFiltersTestJSON-1014675120 tempest-ListImageFiltersTestJSON-1014675120-project-member] Enqueued Resource ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f with Priority: HIGHEST for action security_group_members [ 743.298031] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f with Priority: HIGHEST for action security_group_members [ 743.298663] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.298799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.298865] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.299111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.299271] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.299376] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.299442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.299600] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.299688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.299784] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.608553] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.609263] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.609489] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.609661] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.609795] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.609941] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b is going to be updated. [ 743.649654] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.649841] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.649841] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.650217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.650217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.659167] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b in Status: IN_PROGRESS for 2s [ 743.735544] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-207 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.735761] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.735889] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.736497] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.736826] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.737065] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.737442] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.737729] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.738205] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.738494] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 743.738676] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 743.738949] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 743.739134] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 743.739470] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 743.739646] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 743.739818] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 743.759387] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 743.759566] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 743.759704] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 743.759874] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.760233] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-0d02a2be-1a9c-48c3-93c8-28b312303384 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.760408] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-0d02a2be-1a9c-48c3-93c8-28b312303384" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.760531] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-0d02a2be-1a9c-48c3-93c8-28b312303384" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.761054] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-0d02a2be-1a9c-48c3-93c8-28b312303384" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.761054] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d02a2be-1a9c-48c3-93c8-28b312303384',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.786715] env[69920]: INFO networking_nsxv3.common.synchronization [None req-03fa79d2-c6c9-4848-bc4c-7d24d2246fbc None None] Enqueued Resource ID: 903d7120-c3d9-44a2-b1b6-fce388e302f3 with Priority: HIGHEST for action port [ 743.787245] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 903d7120-c3d9-44a2-b1b6-fce388e302f3 with Priority: HIGHEST for action port [ 743.787656] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-903d7120-c3d9-44a2-b1b6-fce388e302f3 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.787989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-903d7120-c3d9-44a2-b1b6-fce388e302f3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.788114] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-903d7120-c3d9-44a2-b1b6-fce388e302f3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.788413] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-903d7120-c3d9-44a2-b1b6-fce388e302f3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.788520] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('903d7120-c3d9-44a2-b1b6-fce388e302f3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.804319] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.264274] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.264488] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.264615] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.264909] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.265077] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.265239] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 0d02a2be-1a9c-48c3-93c8-28b312303384 not found, creating... [ 744.265492] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.265653] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.265784] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.265998] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.266145] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.266424] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.266575] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.266689] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.266893] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.268398] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.268616] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 0d02a2be-1a9c-48c3-93c8-28b312303384 is going to be created. [ 744.292022] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.292203] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.292321] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.292602] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.292827] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.293148] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-0d02a2be-1a9c-48c3-93c8-28b312303384" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.294271] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 903d7120-c3d9-44a2-b1b6-fce388e302f3 [ 744.294525] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.294707] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.294836] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.295203] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.295377] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.295565] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:903d7120-c3d9-44a2-b1b6-fce388e302f3 already deleted. [ 744.295696] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-903d7120-c3d9-44a2-b1b6-fce388e302f3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.309314] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.601570] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 in Status: SUCCESS [ 744.604022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.604022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.604022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.604022] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.604022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.604022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.604022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.604022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.604022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.604022] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.813184] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.813486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.813486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.813624] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.813712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.813852] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f is going to be updated. [ 744.857206] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.857206] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.857206] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.858617] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.858617] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.872123] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f in Status: IN_PROGRESS for 2s [ 745.106940] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.107109] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.107109] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.108036] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.109260] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.109260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.109260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.109260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.109260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.109260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.109497] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.109497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.109497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.109667] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.109815] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.109909] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.109971] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.110126] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.110203] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.110287] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.110375] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.143010] env[69920]: INFO networking_nsxv3.common.synchronization [req-db62ef13-d828-4299-a55c-038b49f2de70 req-10d83e68-13a9-4ee4-a737-ad6766ce10c0 service nova] Enqueued Resource ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f with Priority: HIGHEST for action security_group_rules [ 745.143308] env[69920]: INFO networking_nsxv3.common.synchronization [req-db62ef13-d828-4299-a55c-038b49f2de70 req-10d83e68-13a9-4ee4-a737-ad6766ce10c0 service nova] Enqueued Resource ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f with Priority: HIGHEST for action security_group_members [ 745.144503] env[69920]: INFO networking_nsxv3.common.synchronization [req-db62ef13-d828-4299-a55c-038b49f2de70 req-10d83e68-13a9-4ee4-a737-ad6766ce10c0 service nova] Enqueued Resource ID: 0d02a2be-1a9c-48c3-93c8-28b312303384 with Priority: HIGHEST for action port [ 745.144503] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f with Priority: HIGHEST for action security_group_rules [ 745.144503] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f with Priority: HIGHEST for action security_group_members [ 745.144503] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d02a2be-1a9c-48c3-93c8-28b312303384 with Priority: HIGHEST for action port [ 745.146551] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.146551] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.146551] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.146551] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.146551] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.147571] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.147620] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.147863] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d02a2be-1a9c-48c3-93c8-28b312303384 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.147997] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d02a2be-1a9c-48c3-93c8-28b312303384" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.148268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d02a2be-1a9c-48c3-93c8-28b312303384" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.148537] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d02a2be-1a9c-48c3-93c8-28b312303384" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.148663] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d02a2be-1a9c-48c3-93c8-28b312303384',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.613274] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5: rpc.has_security_group_logging(os_id): False [ 745.633219] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.633371] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.633440] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.633670] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.633765] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.634029] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.634130] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.634198] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.634363] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.634443] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.634619] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.634712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.634773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.634941] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.635028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.635213] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.635308] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.635370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.635508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.635581] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.635663] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 is going to be created. [ 745.651030] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.651123] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.652513] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d02a2be-1a9c-48c3-93c8-28b312303384 with status ACTIVE [ 745.652712] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.655649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.655649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.655649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.655649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.655649] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.655649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.655649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.655649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.655649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.655649] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.655649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.655649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.655649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.655649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.655649] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d02a2be-1a9c-48c3-93c8-28b312303384 is going to be updated. [ 745.679144] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b in Status: SUCCESS [ 745.679144] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.679144] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.679245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.679793] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.679793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.679793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.679793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.679793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.680009] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.685905] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.686877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.686877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.686877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.686877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.686877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d02a2be-1a9c-48c3-93c8-28b312303384" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.714432] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.714665] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.714737] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.714944] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.715138] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.727506] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 in Status: IN_PROGRESS for 2s [ 745.882900] env[69920]: INFO networking_nsxv3.common.synchronization [None req-e5089fa7-d6de-4eb3-9216-3b2813aa9e84 None None] Enqueued Resource ID: 4850e97e-35b0-49b7-a16d-72850ac84cbb with Priority: HIGHEST for action port [ 745.883490] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4850e97e-35b0-49b7-a16d-72850ac84cbb with Priority: HIGHEST for action port [ 745.883935] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-4850e97e-35b0-49b7-a16d-72850ac84cbb taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.884166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4850e97e-35b0-49b7-a16d-72850ac84cbb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.884166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4850e97e-35b0-49b7-a16d-72850ac84cbb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.884545] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4850e97e-35b0-49b7-a16d-72850ac84cbb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.884640] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4850e97e-35b0-49b7-a16d-72850ac84cbb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.185244] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.185244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.185244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.185244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.185244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.185244] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.185244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.185244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.185244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.185244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.185244] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b is going to be updated. [ 746.217188] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.217370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.217413] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.217616] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.217760] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.241996] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b in Status: IN_PROGRESS for 2s [ 746.386866] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4850e97e-35b0-49b7-a16d-72850ac84cbb [ 746.387082] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.388208] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.388208] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.388208] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.388208] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.388208] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4850e97e-35b0-49b7-a16d-72850ac84cbb already deleted. [ 746.388208] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4850e97e-35b0-49b7-a16d-72850ac84cbb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.884304] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f in Status: SUCCESS [ 746.884688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.884688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.885976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.885976] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.885976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.885976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.885976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.885976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.885976] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.388519] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.743014] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 in Status: SUCCESS [ 747.743200] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.892463] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.060343] env[69920]: INFO networking_nsxv3.common.synchronization [req-365e6496-1356-4369-962b-d7213220e718 req-12891883-5c06-4c4d-9f1d-d0d7ea260eb5 tempest-AttachVolumeTestJSON-218421131 tempest-AttachVolumeTestJSON-218421131-project-member] Enqueued Resource ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 with Priority: HIGHEST for action security_group_members [ 748.060847] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 with Priority: HIGHEST for action security_group_members [ 748.061439] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a8bd4df-a8df-4d64-94ea-a00a62c48a01 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.061633] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.061746] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.062137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.062549] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.062549] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.062549] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.063025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.063025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.063205] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a8bd4df-a8df-4d64-94ea-a00a62c48a01',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.251884] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b in Status: SUCCESS [ 748.252584] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b deletion is rescheduled due to dependency. [ 748.252584] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.399037] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.399037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.399037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.399037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.399037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.399037] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f is going to be updated. [ 748.413466] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-269 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.413576] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-269" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.413699] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-269" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.414162] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-269" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.414409] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.414567] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.414694] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.415587] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.415723] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.415929] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 748.416060] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 748.416203] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 748.416879] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 748.416879] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 748.416879] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 748.416879] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 748.426170] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.426310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.426375] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.426603] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.426727] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.436172] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f in Status: IN_PROGRESS for 2s [ 748.438955] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 748.438955] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 748.438955] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 748.438955] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-269" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.438955] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-2d989e8c-d768-494a-a866-4da8ff809d05 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.439466] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-2d989e8c-d768-494a-a866-4da8ff809d05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.439708] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-2d989e8c-d768-494a-a866-4da8ff809d05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.440129] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-2d989e8c-d768-494a-a866-4da8ff809d05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.440387] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d989e8c-d768-494a-a866-4da8ff809d05',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.567022] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.567022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.567022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.568946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.568946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.568946] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.568946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.568946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.568946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.568946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.568946] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 already deleted. [ 748.568946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.943440] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.943836] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.943836] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.944162] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.944315] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.944468] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 2d989e8c-d768-494a-a866-4da8ff809d05 not found, creating... [ 748.944724] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.944948] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.945270] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.945382] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.945539] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.945741] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.945896] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.946029] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.946234] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.946367] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.946503] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 2d989e8c-d768-494a-a866-4da8ff809d05 is going to be created. [ 748.965726] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.966236] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.966236] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.966485] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.967043] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.967648] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-2d989e8c-d768-494a-a866-4da8ff809d05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.660544] env[69920]: INFO networking_nsxv3.common.synchronization [req-365e6496-1356-4369-962b-d7213220e718 req-b1de1b5d-3ba7-4d77-a5c1-2b0fafcb7d8e service nova] Enqueued Resource ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 with Priority: HIGHEST for action security_group_rules [ 749.660751] env[69920]: INFO networking_nsxv3.common.synchronization [req-365e6496-1356-4369-962b-d7213220e718 req-b1de1b5d-3ba7-4d77-a5c1-2b0fafcb7d8e service nova] Enqueued Resource ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 with Priority: HIGHEST for action security_group_members [ 749.660896] env[69920]: INFO networking_nsxv3.common.synchronization [req-365e6496-1356-4369-962b-d7213220e718 req-b1de1b5d-3ba7-4d77-a5c1-2b0fafcb7d8e service nova] Enqueued Resource ID: 2d989e8c-d768-494a-a866-4da8ff809d05 with Priority: HIGHEST for action port [ 749.661163] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 with Priority: HIGHEST for action security_group_rules [ 749.661289] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 with Priority: HIGHEST for action security_group_members [ 749.661384] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d989e8c-d768-494a-a866-4da8ff809d05 with Priority: HIGHEST for action port [ 749.661985] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a8bd4df-a8df-4d64-94ea-a00a62c48a01 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.662812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.662944] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.663219] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.663328] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a8bd4df-a8df-4d64-94ea-a00a62c48a01',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.664924] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a8bd4df-a8df-4d64-94ea-a00a62c48a01 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.665127] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.665232] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.665442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.665632] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.665768] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.665861] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.666056] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.666183] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.666309] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a8bd4df-a8df-4d64-94ea-a00a62c48a01',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.667749] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d989e8c-d768-494a-a866-4da8ff809d05 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.667858] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d989e8c-d768-494a-a866-4da8ff809d05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.667928] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d989e8c-d768-494a-a866-4da8ff809d05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.669063] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d989e8c-d768-494a-a866-4da8ff809d05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.669063] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d989e8c-d768-494a-a866-4da8ff809d05',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.169641] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a8bd4df-a8df-4d64-94ea-a00a62c48a01 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.169968] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.171273] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d989e8c-d768-494a-a866-4da8ff809d05 with status ACTIVE [ 750.171576] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.171657] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.171742] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.172144] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.172259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.172478] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.172583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.172696] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.172815] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.172890] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.173099] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.173263] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.173263] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.173378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.173456] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.174526] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d989e8c-d768-494a-a866-4da8ff809d05 is going to be updated. [ 750.174953] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a8bd4df-a8df-4d64-94ea-a00a62c48a01',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.215898] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.216106] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.216187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.216492] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.216635] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.216848] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d989e8c-d768-494a-a866-4da8ff809d05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.448136] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f in Status: SUCCESS [ 750.448942] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.448942] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.448942] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.448942] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.449180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.449180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.449298] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.449325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.449774] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.449774] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.678442] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a8bd4df-a8df-4d64-94ea-a00a62c48a01',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.953786] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.954575] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.954575] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.954575] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.954575] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.954575] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.954875] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.954875] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.954875] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.954995] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.955097] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.955206] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.955266] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.955409] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.955562] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.955652] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.955733] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.955878] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.955955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.956067] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.956165] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.180593] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.180927] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.180927] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.181572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.181572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.181572] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 is going to be created. [ 751.209747] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.209930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.209975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.210347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.210552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.220302] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 in Status: UNINITIALIZED for 2s [ 751.459077] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f: rpc.has_security_group_logging(os_id): False [ 751.508377] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.508584] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.508584] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.508846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.508947] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.509177] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.509291] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.509357] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.509562] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.509648] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.509862] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.509995] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.510090] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.510263] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.510357] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.510546] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.510662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.510742] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.510896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.511006] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.511214] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f is going to be updated. [ 751.521730] env[69920]: INFO networking_nsxv3.common.synchronization [req-cade5f02-75db-46f8-b800-9a9fce362c4b req-fb04475a-9549-4b2c-8505-9c311b4f2a27 tempest-ServerAddressesTestJSON-1437605563 tempest-ServerAddressesTestJSON-1437605563-project-member] Enqueued Resource ID: fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 with Priority: HIGHEST for action security_group_members [ 751.522320] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 with Priority: HIGHEST for action security_group_members [ 751.522634] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.522741] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.522815] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.522999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.523165] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.523360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.523360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.523541] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.523629] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.523722] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.586819] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.586993] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.587070] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.587294] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.587438] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.604027] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f in Status: IN_PROGRESS for 2s [ 752.026873] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.027147] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.027238] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.027500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.027607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.027858] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.027978] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.028060] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.028245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.028337] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.028431] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 is going to be updated. [ 752.079304] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.079602] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.079602] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.079824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.080094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.089797] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 in Status: IN_PROGRESS for 2s [ 753.231323] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 in Status: SUCCESS [ 753.231608] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.231853] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.232052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.232282] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.232437] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.232532] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.232734] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.232854] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.232973] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.233759] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a8bd4df-a8df-4d64-94ea-a00a62c48a01',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.619878] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f in Status: SUCCESS [ 753.620896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.735885] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a8bd4df-a8df-4d64-94ea-a00a62c48a01',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.107024] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 in Status: SUCCESS [ 754.107024] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 deletion is rescheduled due to dependency. [ 754.107024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.240487] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a8bd4df-a8df-4d64-94ea-a00a62c48a01: rpc.has_security_group_logging(os_id): False [ 754.259778] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.260039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.260133] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.260496] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.260662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.261088] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.261277] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.261395] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.261673] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.261822] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.261993] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 is going to be created. [ 754.333218] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.333392] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.333434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.333658] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.333989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.349229] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 in Status: IN_PROGRESS for 2s [ 755.645237] env[69920]: INFO networking_nsxv3.common.synchronization [req-9f2a7c47-7686-4cca-a7b6-59647d333396 req-b196f9f2-32d8-4f0d-a486-b9e700cca75e tempest-ServerDiskConfigTestJSON-714416826 tempest-ServerDiskConfigTestJSON-714416826-project-member] Enqueued Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 755.645936] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 755.646181] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.646304] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.646372] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.646625] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.646775] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.646872] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.646934] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.647653] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.647653] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.647653] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.115755] env[69920]: INFO networking_nsxv3.common.synchronization [None req-3719d2d0-3c09-497c-a7ec-832fd1a80652 None None] Enqueued Resource ID: 5480c3c7-8437-4b00-b4a0-4affb53b9199 with Priority: HIGHEST for action port [ 756.116609] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5480c3c7-8437-4b00-b4a0-4affb53b9199 with Priority: HIGHEST for action port [ 756.120709] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-5480c3c7-8437-4b00-b4a0-4affb53b9199 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.120709] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5480c3c7-8437-4b00-b4a0-4affb53b9199" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.120900] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5480c3c7-8437-4b00-b4a0-4affb53b9199" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.122043] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5480c3c7-8437-4b00-b4a0-4affb53b9199" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.122043] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5480c3c7-8437-4b00-b4a0-4affb53b9199',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.154279] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.154279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.154279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.154279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.154279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.154279] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.154279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.154279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.154279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.154279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.154279] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 already deleted. [ 756.154279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.253020] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-538 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.253020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-538" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.253020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-538" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.253020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-538" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.253020] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.253020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.253020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.253020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.253020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.253020] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 756.253020] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 756.253020] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 756.253020] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 756.253637] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 756.253637] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 756.253637] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 756.280023] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 756.280023] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 756.280023] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 756.280023] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-538" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.280023] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-9fe1cc7b-35d7-4f3c-84fa-29a7b02aaf97 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.280023] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-9fe1cc7b-35d7-4f3c-84fa-29a7b02aaf97" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.280023] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-9fe1cc7b-35d7-4f3c-84fa-29a7b02aaf97" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.280023] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-9fe1cc7b-35d7-4f3c-84fa-29a7b02aaf97" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.280023] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fe1cc7b-35d7-4f3c-84fa-29a7b02aaf97',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.361540] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 in Status: SUCCESS [ 756.361778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.626710] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5480c3c7-8437-4b00-b4a0-4affb53b9199 [ 756.626710] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.626850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.626921] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.627190] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.627289] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.627399] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5480c3c7-8437-4b00-b4a0-4affb53b9199 already deleted. [ 756.627484] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5480c3c7-8437-4b00-b4a0-4affb53b9199" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.783079] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.784393] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.784887] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.786327] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.786567] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.786663] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 9fe1cc7b-35d7-4f3c-84fa-29a7b02aaf97 not found, creating... [ 756.787352] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.787352] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.787352] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.787524] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.787630] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.787926] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.788235] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.788776] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.788776] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.788891] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.789121] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 9fe1cc7b-35d7-4f3c-84fa-29a7b02aaf97 is going to be created. [ 756.816434] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.816663] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.816791] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.817081] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.817318] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.817584] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-9fe1cc7b-35d7-4f3c-84fa-29a7b02aaf97" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.496240] env[69920]: INFO networking_nsxv3.common.synchronization [req-9f2a7c47-7686-4cca-a7b6-59647d333396 req-6fa2e10c-3ef3-4c07-9f76-8c87e47bb54c service nova] Enqueued Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_rules [ 757.496438] env[69920]: INFO networking_nsxv3.common.synchronization [req-9f2a7c47-7686-4cca-a7b6-59647d333396 req-6fa2e10c-3ef3-4c07-9f76-8c87e47bb54c service nova] Enqueued Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 757.496610] env[69920]: INFO networking_nsxv3.common.synchronization [req-9f2a7c47-7686-4cca-a7b6-59647d333396 req-6fa2e10c-3ef3-4c07-9f76-8c87e47bb54c service nova] Enqueued Resource ID: 9fe1cc7b-35d7-4f3c-84fa-29a7b02aaf97 with Priority: HIGHEST for action port [ 757.497176] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_rules [ 757.497578] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 757.497721] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fe1cc7b-35d7-4f3c-84fa-29a7b02aaf97 with Priority: HIGHEST for action port [ 757.500066] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.500217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.500286] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.500502] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.500589] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.501434] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.501577] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.501629] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.501940] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.501940] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.502084] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.502134] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.502506] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.502506] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.502506] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.504477] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fe1cc7b-35d7-4f3c-84fa-29a7b02aaf97 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.505458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fe1cc7b-35d7-4f3c-84fa-29a7b02aaf97" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.505458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fe1cc7b-35d7-4f3c-84fa-29a7b02aaf97" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.505458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fe1cc7b-35d7-4f3c-84fa-29a7b02aaf97" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.505458] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fe1cc7b-35d7-4f3c-84fa-29a7b02aaf97',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.007190] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.008597] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.008597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.008597] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9fe1cc7b-35d7-4f3c-84fa-29a7b02aaf97 with status ACTIVE [ 758.008597] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.008911] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.008911] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.009042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.009178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.009390] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.009477] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.009524] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.009711] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.009860] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.010694] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.010694] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.010694] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.010694] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.010694] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.010694] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9fe1cc7b-35d7-4f3c-84fa-29a7b02aaf97 is going to be updated. [ 758.041222] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.041222] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.041222] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.041602] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.041602] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.041740] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fe1cc7b-35d7-4f3c-84fa-29a7b02aaf97" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.137018] env[69920]: INFO networking_nsxv3.common.synchronization [None req-193755de-9eb2-456e-b26e-083b1f5f54fd None None] Enqueued Resource ID: 5fe5431b-7b8e-41a5-ba0d-1f7e939315ff with Priority: HIGHEST for action port [ 758.137018] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fe5431b-7b8e-41a5-ba0d-1f7e939315ff with Priority: HIGHEST for action port [ 758.137018] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fe5431b-7b8e-41a5-ba0d-1f7e939315ff taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.137018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fe5431b-7b8e-41a5-ba0d-1f7e939315ff" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.137018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fe5431b-7b8e-41a5-ba0d-1f7e939315ff" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.137018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fe5431b-7b8e-41a5-ba0d-1f7e939315ff" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.137018] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fe5431b-7b8e-41a5-ba0d-1f7e939315ff',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.513522] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.638646] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5fe5431b-7b8e-41a5-ba0d-1f7e939315ff [ 758.638839] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.638954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.639023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.639685] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.639781] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.639881] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5fe5431b-7b8e-41a5-ba0d-1f7e939315ff already deleted. [ 758.640197] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fe5431b-7b8e-41a5-ba0d-1f7e939315ff" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.015371] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.016079] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.016079] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.016288] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.016288] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.016421] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 is going to be created. [ 759.053259] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.056137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.056137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.056137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.056137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.068172] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: UNINITIALIZED for 2s [ 760.654266] env[69920]: INFO networking_nsxv3.common.synchronization [req-9d63c26c-4b2b-4a96-b4d1-fe3211629c7b req-a9416291-8402-475e-ba6c-a6f79af7bcf4 tempest-VolumesAdminNegativeTest-1491739297 tempest-VolumesAdminNegativeTest-1491739297-project-member] Enqueued Resource ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac with Priority: HIGHEST for action security_group_members [ 760.654819] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac with Priority: HIGHEST for action security_group_members [ 760.655139] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.655259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.655329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.655591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.655800] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.655890] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.655890] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.656063] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.656154] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.656245] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.084140] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: SUCCESS [ 761.084140] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.084370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.084542] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.084733] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.084853] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.084915] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.085935] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.085935] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.085935] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.085935] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.146832] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-614 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.146832] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-614" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.147018] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-614" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.147243] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-614" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.147519] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.147680] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.147814] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.148031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.148290] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.149409] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.149409] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.149409] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.149409] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.149409] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.149409] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.149409] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.158288] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.158427] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.158496] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.158721] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.158810] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.158997] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.160064] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.160064] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.160064] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.160064] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.160064] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac already deleted. [ 761.160064] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.172053] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.172133] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 761.172272] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.172480] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-614" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.172807] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-8c604e20-6cfc-4498-a689-d24876c07513 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.173014] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-8c604e20-6cfc-4498-a689-d24876c07513" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.173287] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-8c604e20-6cfc-4498-a689-d24876c07513" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.173421] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-8c604e20-6cfc-4498-a689-d24876c07513" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.173557] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c604e20-6cfc-4498-a689-d24876c07513',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.590118] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.590118] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.590118] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.590118] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.590372] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.590495] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.590558] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.590756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.590843] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.591599] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.591599] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.591599] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.591599] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.591599] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.591599] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.591917] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.591917] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.591917] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.591917] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.592127] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.592127] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.676566] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.676915] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.676915] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.677231] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.677363] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.677519] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 8c604e20-6cfc-4498-a689-d24876c07513 not found, creating... [ 761.677785] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.677946] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.678074] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.678338] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.678457] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.678805] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.678990] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.679161] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.679515] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.679584] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.679724] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 8c604e20-6cfc-4498-a689-d24876c07513 is going to be created. [ 761.701070] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.701342] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.701528] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.704250] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.704250] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.704250] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-8c604e20-6cfc-4498-a689-d24876c07513" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.095455] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7eba410e-a0d6-4873-9363-054f457d21d4: rpc.has_security_group_logging(os_id): False [ 762.116710] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.116710] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.116710] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.117769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.117769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.117769] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.117769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.117769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.117769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.117769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.117769] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.117769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.117769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.118213] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.118213] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.118322] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.118395] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.118482] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.118656] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.118738] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.118836] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 is going to be created. [ 762.190261] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.191215] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.191331] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.191644] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.191841] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.205107] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: IN_PROGRESS for 2s [ 762.825322] env[69920]: INFO networking_nsxv3.common.synchronization [req-9d63c26c-4b2b-4a96-b4d1-fe3211629c7b req-32e51eea-8b25-47b0-b3c9-7b540c6a4f51 service nova] Enqueued Resource ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac with Priority: HIGHEST for action security_group_rules [ 762.825760] env[69920]: INFO networking_nsxv3.common.synchronization [req-9d63c26c-4b2b-4a96-b4d1-fe3211629c7b req-32e51eea-8b25-47b0-b3c9-7b540c6a4f51 service nova] Enqueued Resource ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac with Priority: HIGHEST for action security_group_members [ 762.825952] env[69920]: INFO networking_nsxv3.common.synchronization [req-9d63c26c-4b2b-4a96-b4d1-fe3211629c7b req-32e51eea-8b25-47b0-b3c9-7b540c6a4f51 service nova] Enqueued Resource ID: 8c604e20-6cfc-4498-a689-d24876c07513 with Priority: HIGHEST for action port [ 762.827141] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac with Priority: HIGHEST for action security_group_rules [ 762.827657] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac with Priority: HIGHEST for action security_group_members [ 762.827820] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c604e20-6cfc-4498-a689-d24876c07513 with Priority: HIGHEST for action port [ 762.828146] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.828294] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.828378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.828621] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.828781] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.829725] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.829850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.830259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.830259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.830582] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.830582] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.830582] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.830723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.830723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.831086] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.832133] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c604e20-6cfc-4498-a689-d24876c07513 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.832133] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c604e20-6cfc-4498-a689-d24876c07513" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.832133] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c604e20-6cfc-4498-a689-d24876c07513" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.832358] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c604e20-6cfc-4498-a689-d24876c07513" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.832358] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c604e20-6cfc-4498-a689-d24876c07513',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.337204] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.337204] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.337204] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.338257] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c604e20-6cfc-4498-a689-d24876c07513 with status ACTIVE [ 763.338351] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.338468] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.338537] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.338758] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.338842] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.339128] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.339298] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.339298] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.339479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.339479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.339623] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.339718] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.339812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.339917] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.339991] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.340085] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c604e20-6cfc-4498-a689-d24876c07513 is going to be updated. [ 763.364677] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.364835] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.364946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.365168] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.365419] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.365458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c604e20-6cfc-4498-a689-d24876c07513" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.559317] env[69920]: INFO networking_nsxv3.common.synchronization [None req-8ff4a98a-7f78-4efa-a22d-b67e147c017c None None] Enqueued Resource ID: 201c941e-d6ac-4888-9cef-01688861ed53 with Priority: HIGHEST for action port [ 763.560015] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 201c941e-d6ac-4888-9cef-01688861ed53 with Priority: HIGHEST for action port [ 763.560366] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-201c941e-d6ac-4888-9cef-01688861ed53 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.560494] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-201c941e-d6ac-4888-9cef-01688861ed53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.560581] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-201c941e-d6ac-4888-9cef-01688861ed53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.561417] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-201c941e-d6ac-4888-9cef-01688861ed53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.561417] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('201c941e-d6ac-4888-9cef-01688861ed53',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.837618] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.065207] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 201c941e-d6ac-4888-9cef-01688861ed53 [ 764.065364] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.065493] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.065575] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.067049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.067049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.067049] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:201c941e-d6ac-4888-9cef-01688861ed53 already deleted. [ 764.067275] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-201c941e-d6ac-4888-9cef-01688861ed53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.217720] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: SUCCESS [ 764.218248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.339860] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.340248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.340248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.340340] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.340379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.340482] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac is going to be created. [ 764.368855] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.368855] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.368855] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.368855] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.369226] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.380428] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac in Status: UNINITIALIZED for 2s [ 764.868772] env[69920]: INFO networking_nsxv3.common.synchronization [req-2cadaf55-5825-4c72-8d34-a7ce77b10560 req-17edb66e-2085-4090-91e5-bd795748f239 tempest-SecurityGroupRulesNegativeTestJSON-220160986 tempest-SecurityGroupRulesNegativeTestJSON-220160986-project-member] Enqueued Resource ID: b0d090e0-d523-487a-b656-12e5be22489e with Priority: HIGHEST for action security_group_rules [ 764.869412] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0d090e0-d523-487a-b656-12e5be22489e with Priority: HIGHEST for action security_group_rules [ 764.869628] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0d090e0-d523-487a-b656-12e5be22489e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.872043] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0d090e0-d523-487a-b656-12e5be22489e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.872043] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0d090e0-d523-487a-b656-12e5be22489e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.872043] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0d090e0-d523-487a-b656-12e5be22489e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.872043] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0d090e0-d523-487a-b656-12e5be22489e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.395522] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.396591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.396591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.396591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.396591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.396591] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0d090e0-d523-487a-b656-12e5be22489e already deleted. [ 765.396591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0d090e0-d523-487a-b656-12e5be22489e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.022975] env[69920]: INFO networking_nsxv3.common.synchronization [req-926524f9-6ad7-49cf-8693-660540025f65 req-35cc5761-bab6-4e1c-a018-455701f22e29 tempest-SecurityGroupRulesNegativeTestJSON-220160986 tempest-SecurityGroupRulesNegativeTestJSON-220160986-project-member] Enqueued Resource ID: b0d090e0-d523-487a-b656-12e5be22489e with Priority: HIGHEST for action security_group_rules [ 766.023615] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0d090e0-d523-487a-b656-12e5be22489e with Priority: HIGHEST for action security_group_rules [ 766.023999] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0d090e0-d523-487a-b656-12e5be22489e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.026034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0d090e0-d523-487a-b656-12e5be22489e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.026034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0d090e0-d523-487a-b656-12e5be22489e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.026034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0d090e0-d523-487a-b656-12e5be22489e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.026034] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0d090e0-d523-487a-b656-12e5be22489e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.166470] env[69920]: INFO networking_nsxv3.common.synchronization [None req-a5fbbea6-eeb8-49e2-a7c5-f2ffed1f114b None None] Enqueued Resource ID: a23b9dea-7379-4cf0-9d85-95f743380779 with Priority: HIGHEST for action port [ 766.167658] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a23b9dea-7379-4cf0-9d85-95f743380779 with Priority: HIGHEST for action port [ 766.167658] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-a23b9dea-7379-4cf0-9d85-95f743380779 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.167658] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a23b9dea-7379-4cf0-9d85-95f743380779" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.167658] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a23b9dea-7379-4cf0-9d85-95f743380779" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.167823] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a23b9dea-7379-4cf0-9d85-95f743380779" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.167946] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a23b9dea-7379-4cf0-9d85-95f743380779',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.390597] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac in Status: SUCCESS [ 766.390921] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.391111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.391372] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.391525] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.391642] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.391703] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.391860] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.391955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.392065] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.392160] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.553185] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.553358] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.553358] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.553550] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.553641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.553737] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0d090e0-d523-487a-b656-12e5be22489e already deleted. [ 766.553821] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0d090e0-d523-487a-b656-12e5be22489e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.673131] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a23b9dea-7379-4cf0-9d85-95f743380779 [ 766.673131] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.673131] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.673131] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.673131] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.673131] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.673131] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a23b9dea-7379-4cf0-9d85-95f743380779 already deleted. [ 766.673131] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a23b9dea-7379-4cf0-9d85-95f743380779" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.787951] env[69920]: INFO networking_nsxv3.common.synchronization [None req-d99e7a67-2b60-4256-aeec-0a4845258dcb tempest-MigrationsAdminTest-685805879 tempest-MigrationsAdminTest-685805879-project-member] Enqueued Resource ID: eb261480-cbe2-4d05-84d8-a1f0067d2ed6 with Priority: HIGHEST for action security_group_rules [ 766.788650] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb261480-cbe2-4d05-84d8-a1f0067d2ed6 with Priority: HIGHEST for action security_group_rules [ 766.788921] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb261480-cbe2-4d05-84d8-a1f0067d2ed6 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.790205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb261480-cbe2-4d05-84d8-a1f0067d2ed6" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.790346] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb261480-cbe2-4d05-84d8-a1f0067d2ed6" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.790744] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb261480-cbe2-4d05-84d8-a1f0067d2ed6" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.790868] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb261480-cbe2-4d05-84d8-a1f0067d2ed6',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.061483] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.063311] env[69920]: INFO networking_nsxv3.common.synchronization [None req-d18f9bcc-1d7b-49d1-99b8-83857914a1cb tempest-MigrationsAdminTest-685805879 tempest-MigrationsAdminTest-685805879-project-member] Enqueued Resource ID: eb261480-cbe2-4d05-84d8-a1f0067d2ed6 with Priority: HIGHEST for action security_group_rules [ 767.064661] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb261480-cbe2-4d05-84d8-a1f0067d2ed6 with Priority: HIGHEST for action security_group_rules [ 767.064661] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb261480-cbe2-4d05-84d8-a1f0067d2ed6 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.064661] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb261480-cbe2-4d05-84d8-a1f0067d2ed6" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.303163] env[69920]: INFO networking_nsxv3.common.synchronization [None req-d4a3aa9a-8e11-4105-bfb6-325e2bb1149d None None] Enqueued Resource ID: a75d2f4a-1842-4977-b733-98003ea29e14 with Priority: HIGHEST for action port [ 767.303451] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a75d2f4a-1842-4977-b733-98003ea29e14 with Priority: HIGHEST for action port [ 767.304121] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-a75d2f4a-1842-4977-b733-98003ea29e14 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.304304] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a75d2f4a-1842-4977-b733-98003ea29e14" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.304336] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a75d2f4a-1842-4977-b733-98003ea29e14" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.304723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a75d2f4a-1842-4977-b733-98003ea29e14" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.304847] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a75d2f4a-1842-4977-b733-98003ea29e14',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.318220] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.318398] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.318441] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.318649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.318728] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.318853] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb261480-cbe2-4d05-84d8-a1f0067d2ed6 already deleted. [ 767.318968] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb261480-cbe2-4d05-84d8-a1f0067d2ed6" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.319136] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb261480-cbe2-4d05-84d8-a1f0067d2ed6" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.319305] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb261480-cbe2-4d05-84d8-a1f0067d2ed6" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.319429] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb261480-cbe2-4d05-84d8-a1f0067d2ed6',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.566569] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac: rpc.has_security_group_logging(os_id): False [ 767.588895] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.593292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.593292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.593292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.593292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.593292] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.593292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.593292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.593292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.596918] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.597145] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac is going to be created. [ 767.681383] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.681619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.681619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.681810] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.682013] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.698868] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac in Status: IN_PROGRESS for 2s [ 767.808242] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a75d2f4a-1842-4977-b733-98003ea29e14 [ 767.808794] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.808794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.808794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.808960] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.809051] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.809156] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a75d2f4a-1842-4977-b733-98003ea29e14 already deleted. [ 767.809256] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a75d2f4a-1842-4977-b733-98003ea29e14" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.845037] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.845434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.845603] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.845901] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.846098] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.846287] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb261480-cbe2-4d05-84d8-a1f0067d2ed6 already deleted. [ 767.846456] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb261480-cbe2-4d05-84d8-a1f0067d2ed6" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.706228] env[69920]: INFO networking_nsxv3.common.synchronization [None req-24c8844b-bc08-469a-b71b-0d54d2020746 None None] Enqueued Resource ID: 935c84fe-83f4-4dff-a6a8-a295eda1fba8 with Priority: HIGHEST for action port [ 769.706713] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 935c84fe-83f4-4dff-a6a8-a295eda1fba8 with Priority: HIGHEST for action port [ 769.707430] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-935c84fe-83f4-4dff-a6a8-a295eda1fba8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.707578] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-935c84fe-83f4-4dff-a6a8-a295eda1fba8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.707672] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-935c84fe-83f4-4dff-a6a8-a295eda1fba8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.707994] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-935c84fe-83f4-4dff-a6a8-a295eda1fba8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.707994] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('935c84fe-83f4-4dff-a6a8-a295eda1fba8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.716192] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac in Status: SUCCESS [ 769.717162] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.367234] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 935c84fe-83f4-4dff-a6a8-a295eda1fba8 [ 770.367234] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.367234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.367234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.367234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.367234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.367234] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:935c84fe-83f4-4dff-a6a8-a295eda1fba8 already deleted. [ 770.367234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-935c84fe-83f4-4dff-a6a8-a295eda1fba8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.291706] env[69920]: INFO networking_nsxv3.common.synchronization [req-f9e9a2ba-793b-4411-b235-fe6c43985395 req-e375d18e-eceb-4317-bd59-38f063e19c35 tempest-ServersTestManualDisk-1798148514 tempest-ServersTestManualDisk-1798148514-project-member] Enqueued Resource ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 with Priority: HIGHEST for action security_group_members [ 772.292090] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 with Priority: HIGHEST for action security_group_members [ 772.292194] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e5cbff-80b3-432a-81ac-0bf4249c4679 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.292290] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.292338] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.293455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.293455] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.293455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.293455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.293455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.293455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.293813] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e5cbff-80b3-432a-81ac-0bf4249c4679',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.796600] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.797083] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.798083] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.798547] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.798781] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.799181] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.799439] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.799598] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.800222] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.800517] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.800729] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 is going to be updated. [ 772.834486] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.835385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.835578] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.835837] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.836078] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.850246] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 in Status: IN_PROGRESS for 2s [ 774.863776] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 in Status: SUCCESS [ 774.863776] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 deletion is rescheduled due to dependency. [ 774.863776] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.294433] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 777.294727] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 778.004659] env[69920]: INFO networking_nsxv3.common.synchronization [None req-c57ec5eb-05b2-48e7-9169-a3668c24a35d None None] Enqueued Resource ID: 44f37557-5238-4c4c-a5b4-2455b17b1c07 with Priority: HIGHEST for action port [ 778.005295] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44f37557-5238-4c4c-a5b4-2455b17b1c07 with Priority: HIGHEST for action port [ 778.005725] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-44f37557-5238-4c4c-a5b4-2455b17b1c07 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.006515] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44f37557-5238-4c4c-a5b4-2455b17b1c07" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.006597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44f37557-5238-4c4c-a5b4-2455b17b1c07" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.006952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44f37557-5238-4c4c-a5b4-2455b17b1c07" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.007145] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44f37557-5238-4c4c-a5b4-2455b17b1c07',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.509748] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44f37557-5238-4c4c-a5b4-2455b17b1c07 [ 778.509748] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.509748] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.511522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.511522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.511522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.511522] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44f37557-5238-4c4c-a5b4-2455b17b1c07 already deleted. [ 778.511522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44f37557-5238-4c4c-a5b4-2455b17b1c07" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.808407] env[69920]: INFO networking_nsxv3.common.synchronization [None req-16f3c6be-f550-4161-8c61-826462c080b3 tempest-AttachVolumeShelveTestJSON-389172843 tempest-AttachVolumeShelveTestJSON-389172843-project-member] Enqueued Resource ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf with Priority: HIGHEST for action security_group_rules [ 778.809084] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf with Priority: HIGHEST for action security_group_rules [ 778.809313] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.809433] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.809502] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.809759] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.809840] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.836037] env[69920]: INFO networking_nsxv3.common.synchronization [req-51d5a2c3-d9a1-4079-8ee6-4eaa88f9e640 req-63c6df20-1e64-49d5-8c5f-006277e32405 tempest-DeleteServersAdminTestJSON-1107524716 tempest-DeleteServersAdminTestJSON-1107524716-project-member] Enqueued Resource ID: c27221ee-5342-4aa7-83da-a28291a2021a with Priority: HIGHEST for action security_group_members [ 778.836037] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27221ee-5342-4aa7-83da-a28291a2021a with Priority: HIGHEST for action security_group_members [ 778.836037] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27221ee-5342-4aa7-83da-a28291a2021a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.836037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.836037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.836522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.836522] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.836522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.836522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.836739] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.836841] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.837023] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c27221ee-5342-4aa7-83da-a28291a2021a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.067590] env[69920]: INFO networking_nsxv3.common.synchronization [None req-e0b46e25-d9fe-4cb3-99ea-3da0e0e331a1 tempest-AttachVolumeShelveTestJSON-389172843 tempest-AttachVolumeShelveTestJSON-389172843-project-member] Enqueued Resource ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf with Priority: HIGHEST for action security_group_rules [ 779.068342] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf with Priority: HIGHEST for action security_group_rules [ 779.068719] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.068942] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.215254] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-207 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.215254] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.215254] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.215254] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.215254] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.216112] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.216220] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.216470] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.216669] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.216929] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.217903] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 779.217903] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 779.217903] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 779.217903] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.217903] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 779.217903] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 779.249418] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 779.249595] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 779.249735] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 779.249921] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.250267] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-dc4904f6-1b89-4fc2-9ea9-18f666114c8a taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.250437] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-dc4904f6-1b89-4fc2-9ea9-18f666114c8a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.250552] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-dc4904f6-1b89-4fc2-9ea9-18f666114c8a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.251040] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-dc4904f6-1b89-4fc2-9ea9-18f666114c8a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.251643] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc4904f6-1b89-4fc2-9ea9-18f666114c8a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.339417] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.339677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.339677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.339956] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.340077] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.340384] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.340501] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.340986] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.340986] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.340986] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.340986] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c27221ee-5342-4aa7-83da-a28291a2021a is going to be updated. [ 779.342922] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.343069] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.343124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.343276] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.343362] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.343439] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf already deleted. [ 779.343570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.343773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.343988] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.344105] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.390148] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.390611] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.390745] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.391079] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.391266] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.408741] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27221ee-5342-4aa7-83da-a28291a2021a in Status: IN_PROGRESS for 2s [ 779.755861] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.756186] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.756227] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.756623] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.756686] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.756821] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port dc4904f6-1b89-4fc2-9ea9-18f666114c8a not found, creating... [ 779.757107] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.757268] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.757382] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.757617] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.757852] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.758060] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.758217] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.758337] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.758546] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.758681] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.758820] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: dc4904f6-1b89-4fc2-9ea9-18f666114c8a is going to be created. [ 779.780447] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.780895] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.780895] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.781261] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.782338] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.782948] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-dc4904f6-1b89-4fc2-9ea9-18f666114c8a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.879512] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.879641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.879716] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.879942] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.880047] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.880154] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf already deleted. [ 779.880238] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.669622] env[69920]: INFO networking_nsxv3.common.synchronization [None req-69300dcd-487c-402d-926e-9fa3ae2dcf6a None None] Enqueued Resource ID: 0556170c-f1b8-403e-964d-554e024c0252 with Priority: HIGHEST for action port [ 780.670293] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0556170c-f1b8-403e-964d-554e024c0252 with Priority: HIGHEST for action port [ 780.673634] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-0556170c-f1b8-403e-964d-554e024c0252 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.673856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0556170c-f1b8-403e-964d-554e024c0252" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.673904] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0556170c-f1b8-403e-964d-554e024c0252" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.674927] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0556170c-f1b8-403e-964d-554e024c0252" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.674927] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0556170c-f1b8-403e-964d-554e024c0252',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.869872] env[69920]: INFO networking_nsxv3.common.synchronization [None req-4bfe0776-b778-44a0-abee-face77cd9769 None None] Enqueued Resource ID: 0a3860e3-4e88-4823-8f5e-a97f71dff31d with Priority: HIGHEST for action port [ 780.869872] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a3860e3-4e88-4823-8f5e-a97f71dff31d with Priority: HIGHEST for action port [ 780.870925] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a3860e3-4e88-4823-8f5e-a97f71dff31d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.870925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a3860e3-4e88-4823-8f5e-a97f71dff31d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.870925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a3860e3-4e88-4823-8f5e-a97f71dff31d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.873019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a3860e3-4e88-4823-8f5e-a97f71dff31d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.873019] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a3860e3-4e88-4823-8f5e-a97f71dff31d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.875044] env[69920]: INFO networking_nsxv3.common.synchronization [req-51d5a2c3-d9a1-4079-8ee6-4eaa88f9e640 req-c1ddc2a2-6cc1-4e17-aa7b-fe09300f98eb service nova] Enqueued Resource ID: c27221ee-5342-4aa7-83da-a28291a2021a with Priority: HIGHEST for action security_group_rules [ 780.875044] env[69920]: INFO networking_nsxv3.common.synchronization [req-51d5a2c3-d9a1-4079-8ee6-4eaa88f9e640 req-c1ddc2a2-6cc1-4e17-aa7b-fe09300f98eb service nova] Enqueued Resource ID: c27221ee-5342-4aa7-83da-a28291a2021a with Priority: HIGHEST for action security_group_members [ 780.875420] env[69920]: INFO networking_nsxv3.common.synchronization [req-51d5a2c3-d9a1-4079-8ee6-4eaa88f9e640 req-c1ddc2a2-6cc1-4e17-aa7b-fe09300f98eb service nova] Enqueued Resource ID: dc4904f6-1b89-4fc2-9ea9-18f666114c8a with Priority: HIGHEST for action port [ 780.876698] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27221ee-5342-4aa7-83da-a28291a2021a with Priority: HIGHEST for action security_group_rules [ 780.876907] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27221ee-5342-4aa7-83da-a28291a2021a with Priority: HIGHEST for action security_group_members [ 780.877158] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc4904f6-1b89-4fc2-9ea9-18f666114c8a with Priority: HIGHEST for action port [ 780.879915] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c27221ee-5342-4aa7-83da-a28291a2021a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.879915] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.879915] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.879915] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.879915] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c27221ee-5342-4aa7-83da-a28291a2021a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.879915] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27221ee-5342-4aa7-83da-a28291a2021a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.879915] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.879915] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc4904f6-1b89-4fc2-9ea9-18f666114c8a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.879915] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc4904f6-1b89-4fc2-9ea9-18f666114c8a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.879915] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc4904f6-1b89-4fc2-9ea9-18f666114c8a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.879915] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc4904f6-1b89-4fc2-9ea9-18f666114c8a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.879915] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc4904f6-1b89-4fc2-9ea9-18f666114c8a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.178668] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0556170c-f1b8-403e-964d-554e024c0252 [ 781.179274] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.179274] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.179274] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.179274] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.179487] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.179487] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0556170c-f1b8-403e-964d-554e024c0252 already deleted. [ 781.179573] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0556170c-f1b8-403e-964d-554e024c0252" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.378331] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a3860e3-4e88-4823-8f5e-a97f71dff31d [ 781.378331] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.378331] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.378331] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.378331] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.378331] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.378331] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a3860e3-4e88-4823-8f5e-a97f71dff31d already deleted. [ 781.378331] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a3860e3-4e88-4823-8f5e-a97f71dff31d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.383034] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27221ee-5342-4aa7-83da-a28291a2021a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.383034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.383034] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc4904f6-1b89-4fc2-9ea9-18f666114c8a with status ACTIVE [ 781.383034] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.383034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.383034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.383034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.383034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.383034] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.383034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.383034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.383034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.383034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.383034] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.384315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.384315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.384315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.384315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.384315] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc4904f6-1b89-4fc2-9ea9-18f666114c8a is going to be updated. [ 781.410630] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.410786] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.410858] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.411495] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.411495] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.411642] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc4904f6-1b89-4fc2-9ea9-18f666114c8a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.423356] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27221ee-5342-4aa7-83da-a28291a2021a in Status: SUCCESS [ 781.423918] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c27221ee-5342-4aa7-83da-a28291a2021a deletion is rescheduled due to dependency. [ 781.423918] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.425081] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.425081] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.425081] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.425081] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.425275] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.425564] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.425635] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.425724] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c27221ee-5342-4aa7-83da-a28291a2021a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.452250] env[69920]: INFO networking_nsxv3.common.synchronization [req-dd3f90ce-7244-4dc7-8d56-4bf077ecb761 req-2231ee5d-f89b-46b0-b442-57a73bbf2c9b tempest-ServerDiskConfigTestJSON-714416826 tempest-ServerDiskConfigTestJSON-714416826-project-member] Enqueued Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 781.454944] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 781.456449] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.456449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.456449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.456449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.456449] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.456449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.456449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.456772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.456772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.457819] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.928771] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c27221ee-5342-4aa7-83da-a28291a2021a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.961028] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.961028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.961028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.961028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.961028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.961028] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.965159] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.965159] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.965159] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.965159] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.965159] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 is going to be updated. [ 782.002696] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.003044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.003044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.003360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.003459] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.015966] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: IN_PROGRESS for 2s [ 782.432743] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c27221ee-5342-4aa7-83da-a28291a2021a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.940454] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.940997] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.940997] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.941281] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.941383] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.941471] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c27221ee-5342-4aa7-83da-a28291a2021a is going to be updated. [ 782.993604] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.993800] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.993800] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.993964] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.994125] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.006359] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27221ee-5342-4aa7-83da-a28291a2021a in Status: IN_PROGRESS for 2s [ 783.123201] env[69920]: INFO networking_nsxv3.common.synchronization [None req-a3858830-e88c-4979-9790-5fb34326e5a5 None None] Enqueued Resource ID: aeeb401c-3b0b-4497-be3d-a06c699c0c7e with Priority: HIGHEST for action port [ 783.123920] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aeeb401c-3b0b-4497-be3d-a06c699c0c7e with Priority: HIGHEST for action port [ 783.125221] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-aeeb401c-3b0b-4497-be3d-a06c699c0c7e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.125388] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aeeb401c-3b0b-4497-be3d-a06c699c0c7e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.125448] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aeeb401c-3b0b-4497-be3d-a06c699c0c7e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.125847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aeeb401c-3b0b-4497-be3d-a06c699c0c7e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.125946] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aeeb401c-3b0b-4497-be3d-a06c699c0c7e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.630255] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aeeb401c-3b0b-4497-be3d-a06c699c0c7e [ 783.630683] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.630920] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.630920] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.631073] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.631162] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.631258] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aeeb401c-3b0b-4497-be3d-a06c699c0c7e already deleted. [ 783.631334] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aeeb401c-3b0b-4497-be3d-a06c699c0c7e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.027904] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: SUCCESS [ 784.028244] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 deletion is rescheduled due to dependency. [ 784.028244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.017649] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27221ee-5342-4aa7-83da-a28291a2021a in Status: SUCCESS [ 785.017871] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.018067] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.018295] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.018491] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.018610] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.018674] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.018886] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.018972] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.019123] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.019180] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c27221ee-5342-4aa7-83da-a28291a2021a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.522389] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27221ee-5342-4aa7-83da-a28291a2021a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.522821] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.522821] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.522963] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.523088] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.523189] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.523255] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.523413] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.523730] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.523967] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.524082] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27221ee-5342-4aa7-83da-a28291a2021a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.524132] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.524161] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.524626] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.524626] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.524626] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.524858] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.524858] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.524858] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.524944] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.525077] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c27221ee-5342-4aa7-83da-a28291a2021a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.029322] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c27221ee-5342-4aa7-83da-a28291a2021a: rpc.has_security_group_logging(os_id): False [ 786.063589] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.063589] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.063589] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.063589] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.063589] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.063589] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.063589] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.063589] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.063589] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.063589] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.063589] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.063589] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.063589] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.063589] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.063589] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.064354] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.064354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.064354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.064354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.064354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.064354] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c27221ee-5342-4aa7-83da-a28291a2021a is going to be updated. [ 786.159522] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.159522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.159856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.160327] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.160327] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.189448] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c27221ee-5342-4aa7-83da-a28291a2021a in Status: IN_PROGRESS for 2s [ 788.126294] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 788.126294] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 788.206439] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c27221ee-5342-4aa7-83da-a28291a2021a in Status: SUCCESS [ 788.206671] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.720852] env[69920]: INFO networking_nsxv3.common.synchronization [None req-fdac1242-78bc-4455-8dec-ac22a79aaaff None None] Enqueued Resource ID: f12d1433-8068-4ad7-af23-c5b13421eafb with Priority: HIGHEST for action port [ 788.721570] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f12d1433-8068-4ad7-af23-c5b13421eafb with Priority: HIGHEST for action port [ 788.721885] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-f12d1433-8068-4ad7-af23-c5b13421eafb taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.722011] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f12d1433-8068-4ad7-af23-c5b13421eafb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.722082] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f12d1433-8068-4ad7-af23-c5b13421eafb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.722348] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f12d1433-8068-4ad7-af23-c5b13421eafb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.722430] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f12d1433-8068-4ad7-af23-c5b13421eafb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.225846] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f12d1433-8068-4ad7-af23-c5b13421eafb [ 789.225846] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.225846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.225846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.225846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.225846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.226414] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f12d1433-8068-4ad7-af23-c5b13421eafb already deleted. [ 789.226414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f12d1433-8068-4ad7-af23-c5b13421eafb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.697662] env[69920]: INFO networking_nsxv3.common.synchronization [req-ca22c73a-c84f-4777-a6be-cbc8846e7eb1 req-d660d42a-c54e-41dc-b2fd-bb753119f463 tempest-ServerGroupTestJSON-635802753 tempest-ServerGroupTestJSON-635802753-project-member] Enqueued Resource ID: b3cdaff7-e960-4617-83ae-85aa804dab73 with Priority: HIGHEST for action security_group_members [ 789.697662] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3cdaff7-e960-4617-83ae-85aa804dab73 with Priority: HIGHEST for action security_group_members [ 789.697662] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cdaff7-e960-4617-83ae-85aa804dab73 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.697662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.697662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.698217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.698543] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.698837] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.699048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.700930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.701047] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.701154] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3cdaff7-e960-4617-83ae-85aa804dab73',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.049169] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-78 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.049467] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-78" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.049706] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-78" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.050186] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-78" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.050649] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.050912] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.051118] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.051634] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.051883] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.052199] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 790.053013] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 790.053013] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 790.053013] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 790.053013] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 790.053227] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 790.053404] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 790.075089] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 790.075300] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 790.075453] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 790.075668] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-78" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.076021] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-6ab9e78c-be4f-450a-99bc-80d392d1c61f taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.076227] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-6ab9e78c-be4f-450a-99bc-80d392d1c61f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.076362] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-6ab9e78c-be4f-450a-99bc-80d392d1c61f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.076754] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-6ab9e78c-be4f-450a-99bc-80d392d1c61f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.076885] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ab9e78c-be4f-450a-99bc-80d392d1c61f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.204570] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.204798] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.204798] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.205016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.205144] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.205382] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.205492] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.205541] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.205757] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.205853] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.205940] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3cdaff7-e960-4617-83ae-85aa804dab73 already deleted. [ 790.206032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.580591] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.580893] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.580933] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.581234] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.581387] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.581546] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 6ab9e78c-be4f-450a-99bc-80d392d1c61f not found, creating... [ 790.581813] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.581974] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.582105] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.582427] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.582576] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.582857] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.586819] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.587070] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.587326] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.587479] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.587626] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 6ab9e78c-be4f-450a-99bc-80d392d1c61f is going to be created. [ 790.612680] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.612680] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.612944] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.613069] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.613360] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.613601] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-6ab9e78c-be4f-450a-99bc-80d392d1c61f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.752735] env[69920]: INFO networking_nsxv3.common.synchronization [None req-603e68d9-4e11-4fef-b402-92533272e14b None None] Enqueued Resource ID: 9e0c03b4-b37f-45a5-b538-734add414408 with Priority: HIGHEST for action port [ 790.753377] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e0c03b4-b37f-45a5-b538-734add414408 with Priority: HIGHEST for action port [ 790.753765] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e0c03b4-b37f-45a5-b538-734add414408 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.753922] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e0c03b4-b37f-45a5-b538-734add414408" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.755586] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e0c03b4-b37f-45a5-b538-734add414408" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.756228] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e0c03b4-b37f-45a5-b538-734add414408" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.756228] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e0c03b4-b37f-45a5-b538-734add414408',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.258591] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e0c03b4-b37f-45a5-b538-734add414408 [ 791.258830] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.258958] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.259036] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.259252] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.259338] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.259435] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e0c03b4-b37f-45a5-b538-734add414408 already deleted. [ 791.259513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e0c03b4-b37f-45a5-b538-734add414408" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.443848] env[69920]: INFO networking_nsxv3.common.synchronization [req-ca22c73a-c84f-4777-a6be-cbc8846e7eb1 req-9ce15431-74c3-4534-a1e1-4d4a68cd8b42 service nova] Enqueued Resource ID: b3cdaff7-e960-4617-83ae-85aa804dab73 with Priority: HIGHEST for action security_group_rules [ 791.444101] env[69920]: INFO networking_nsxv3.common.synchronization [req-ca22c73a-c84f-4777-a6be-cbc8846e7eb1 req-9ce15431-74c3-4534-a1e1-4d4a68cd8b42 service nova] Enqueued Resource ID: b3cdaff7-e960-4617-83ae-85aa804dab73 with Priority: HIGHEST for action security_group_members [ 791.444356] env[69920]: INFO networking_nsxv3.common.synchronization [req-ca22c73a-c84f-4777-a6be-cbc8846e7eb1 req-9ce15431-74c3-4534-a1e1-4d4a68cd8b42 service nova] Enqueued Resource ID: 6ab9e78c-be4f-450a-99bc-80d392d1c61f with Priority: HIGHEST for action port [ 791.445636] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3cdaff7-e960-4617-83ae-85aa804dab73 with Priority: HIGHEST for action security_group_rules [ 791.445823] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3cdaff7-e960-4617-83ae-85aa804dab73 with Priority: HIGHEST for action security_group_members [ 791.445974] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab9e78c-be4f-450a-99bc-80d392d1c61f with Priority: HIGHEST for action port [ 791.446373] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3cdaff7-e960-4617-83ae-85aa804dab73 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.446490] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.449512] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.449512] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.449512] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3cdaff7-e960-4617-83ae-85aa804dab73',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.449512] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cdaff7-e960-4617-83ae-85aa804dab73 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.449512] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.449512] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.449512] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.449512] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.449512] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.449512] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.449512] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.452309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.452309] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3cdaff7-e960-4617-83ae-85aa804dab73',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.452733] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ab9e78c-be4f-450a-99bc-80d392d1c61f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.452848] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ab9e78c-be4f-450a-99bc-80d392d1c61f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.452926] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ab9e78c-be4f-450a-99bc-80d392d1c61f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.453264] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ab9e78c-be4f-450a-99bc-80d392d1c61f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.453363] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ab9e78c-be4f-450a-99bc-80d392d1c61f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.569614] env[69920]: INFO networking_nsxv3.common.synchronization [req-db61551e-168a-4dfa-b3ad-5e6347b4a563 req-1bbc7290-ee17-4506-af0c-bc41c5d33383 tempest-ImagesOneServerNegativeTestJSON-924528592 tempest-ImagesOneServerNegativeTestJSON-924528592-project-member] Enqueued Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_members [ 791.570222] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_members [ 791.570570] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.570736] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.570821] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.571139] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.571324] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.571451] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.571528] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.571714] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.571823] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.571930] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.892025] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-444 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.892338] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-444" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.892790] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-444" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.893172] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-444" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.893487] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.893692] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.893956] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.894115] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.894337] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.894620] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 791.894776] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 791.894913] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 791.895153] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 791.895312] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 791.895472] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 791.895641] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 791.918020] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 791.918020] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 791.918020] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 791.918020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-444" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.918020] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-8d92ef1c-0941-4eaa-a28f-e5cf6d76a571 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.918020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-8d92ef1c-0941-4eaa-a28f-e5cf6d76a571" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.918020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-8d92ef1c-0941-4eaa-a28f-e5cf6d76a571" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.918020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-8d92ef1c-0941-4eaa-a28f-e5cf6d76a571" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.918020] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d92ef1c-0941-4eaa-a28f-e5cf6d76a571',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.959722] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cdaff7-e960-4617-83ae-85aa804dab73 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.960022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.960114] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b3cdaff7-e960-4617-83ae-85aa804dab73',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.960882] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ab9e78c-be4f-450a-99bc-80d392d1c61f with status ACTIVE [ 791.961096] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.961248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.961248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.961448] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.961535] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.961732] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.963116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.963116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.963116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.963116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.963116] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.963116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.963116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.963116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.963116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.963116] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ab9e78c-be4f-450a-99bc-80d392d1c61f is going to be updated. [ 791.983651] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.983808] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.983869] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.984043] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.984186] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.984357] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ab9e78c-be4f-450a-99bc-80d392d1c61f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.074468] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.074631] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.074698] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.074903] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.074995] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.075224] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.075322] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.075398] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.075571] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.075652] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.075736] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb already deleted. [ 792.075814] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.230714] env[69920]: INFO networking_nsxv3.common.synchronization [req-db1f6b66-b7a0-48d0-8928-8723211a914f req-5ad5b6b4-e1c9-4348-bdf9-2a826ffe50ee tempest-DeleteServersAdminTestJSON-1107524716 tempest-DeleteServersAdminTestJSON-1107524716-project-member] Enqueued Resource ID: c27221ee-5342-4aa7-83da-a28291a2021a with Priority: HIGHEST for action security_group_members [ 792.231096] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27221ee-5342-4aa7-83da-a28291a2021a with Priority: HIGHEST for action security_group_members [ 792.231408] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c27221ee-5342-4aa7-83da-a28291a2021a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.231542] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.231593] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.231786] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.231933] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.232050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.232112] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.232263] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.232408] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.232464] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c27221ee-5342-4aa7-83da-a28291a2021a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.420678] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.420926] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.421020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.421313] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.421467] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.421623] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 8d92ef1c-0941-4eaa-a28f-e5cf6d76a571 not found, creating... [ 792.421884] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.422101] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.422250] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.422374] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.422511] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.422783] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.422934] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.423065] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.423267] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.423399] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.423538] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 8d92ef1c-0941-4eaa-a28f-e5cf6d76a571 is going to be created. [ 792.444409] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.444670] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.444803] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.445108] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.445455] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.445736] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-8d92ef1c-0941-4eaa-a28f-e5cf6d76a571" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.465477] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b3cdaff7-e960-4617-83ae-85aa804dab73',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.735345] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.735491] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.735568] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.735775] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.735867] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.736077] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.736177] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.736244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.736411] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.736489] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.736577] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c27221ee-5342-4aa7-83da-a28291a2021a is going to be updated. [ 792.767076] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.767241] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.767303] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.767504] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.767641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.777614] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27221ee-5342-4aa7-83da-a28291a2021a in Status: IN_PROGRESS for 2s [ 792.968067] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.968391] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.968391] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.968527] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.968591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.968762] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3cdaff7-e960-4617-83ae-85aa804dab73 is going to be created. [ 792.997146] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.997146] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.997338] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.997439] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.997580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.023820] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3cdaff7-e960-4617-83ae-85aa804dab73 in Status: UNINITIALIZED for 2s [ 793.188255] env[69920]: INFO networking_nsxv3.common.synchronization [req-db61551e-168a-4dfa-b3ad-5e6347b4a563 req-bd441fd9-f88f-4de2-89fc-e32fe037b4af service nova] Enqueued Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_rules [ 793.188437] env[69920]: INFO networking_nsxv3.common.synchronization [req-db61551e-168a-4dfa-b3ad-5e6347b4a563 req-bd441fd9-f88f-4de2-89fc-e32fe037b4af service nova] Enqueued Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_members [ 793.188574] env[69920]: INFO networking_nsxv3.common.synchronization [req-db61551e-168a-4dfa-b3ad-5e6347b4a563 req-bd441fd9-f88f-4de2-89fc-e32fe037b4af service nova] Enqueued Resource ID: 8d92ef1c-0941-4eaa-a28f-e5cf6d76a571 with Priority: HIGHEST for action port [ 793.189137] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_rules [ 793.189229] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_members [ 793.189375] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d92ef1c-0941-4eaa-a28f-e5cf6d76a571 with Priority: HIGHEST for action port [ 793.189623] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f8bd1f0-245d-4d6b-8841-4e7773984ffb taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.189737] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.189804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.190085] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.190155] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.191244] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.191244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.191244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.191455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.192110] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.192110] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.192110] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.192110] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.192110] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.192110] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.192865] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d92ef1c-0941-4eaa-a28f-e5cf6d76a571 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.192970] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d92ef1c-0941-4eaa-a28f-e5cf6d76a571" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.193105] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d92ef1c-0941-4eaa-a28f-e5cf6d76a571" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.193195] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d92ef1c-0941-4eaa-a28f-e5cf6d76a571" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.193269] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d92ef1c-0941-4eaa-a28f-e5cf6d76a571',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.695198] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.695351] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.696698] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.697647] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d92ef1c-0941-4eaa-a28f-e5cf6d76a571 with status ACTIVE [ 793.697793] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.697944] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.697944] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.698169] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.698230] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.698399] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.698549] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.698598] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.698828] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.698828] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.699050] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.699181] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.699235] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.699383] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.699800] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.699800] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d92ef1c-0941-4eaa-a28f-e5cf6d76a571 is going to be updated. [ 793.720793] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.720971] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.721018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.721226] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.721359] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.721522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d92ef1c-0941-4eaa-a28f-e5cf6d76a571" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.204391] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.704835] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.704990] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.704990] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.705232] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.705384] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.705499] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb is going to be created. [ 794.741483] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.741785] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.741785] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.742855] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.742855] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.755079] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb in Status: UNINITIALIZED for 2s [ 794.791994] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c27221ee-5342-4aa7-83da-a28291a2021a in Status: SUCCESS [ 794.792197] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c27221ee-5342-4aa7-83da-a28291a2021a deletion is rescheduled due to dependency. [ 794.792315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.036626] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3cdaff7-e960-4617-83ae-85aa804dab73 in Status: SUCCESS [ 795.036876] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.037056] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.037279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.037551] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.037620] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.038370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.038370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.038370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.038370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.038370] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b3cdaff7-e960-4617-83ae-85aa804dab73',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.540707] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cdaff7-e960-4617-83ae-85aa804dab73 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.540989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.540989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.541190] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.541359] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.541458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.541520] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.541672] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.541759] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.541846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.541991] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cdaff7-e960-4617-83ae-85aa804dab73 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.542429] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.542429] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.542429] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.542799] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.542893] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.542950] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.543113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.543212] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.543270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.543364] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b3cdaff7-e960-4617-83ae-85aa804dab73',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.046154] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b3cdaff7-e960-4617-83ae-85aa804dab73: rpc.has_security_group_logging(os_id): False [ 796.067021] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.067021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.067021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.067021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.067021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.067021] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.067021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.067021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.067021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.067021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.067021] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.067021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.067021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.067021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.067021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.067602] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.067602] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.067602] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.067602] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.067602] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.067602] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3cdaff7-e960-4617-83ae-85aa804dab73 is going to be created. [ 796.156601] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.156897] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.156897] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.157051] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.157230] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.172266] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3cdaff7-e960-4617-83ae-85aa804dab73 in Status: IN_PROGRESS for 2s [ 796.392909] env[69920]: INFO networking_nsxv3.common.synchronization [req-1c0e1eab-db14-4069-bb96-b7700759b7fd req-01a9e94c-d7de-4e61-b86a-b3e2f5a3b3e2 tempest-MultipleCreateTestJSON-1096518746 tempest-MultipleCreateTestJSON-1096518746-project-member] Enqueued Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 796.393629] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 796.393959] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.394176] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.394237] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.394590] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.394815] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.394964] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.395960] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.396172] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.396276] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.396382] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.707166] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-413 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.707166] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-413" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.707604] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-413" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.707604] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-413" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.708216] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.708216] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.708708] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.708708] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.708708] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.708938] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.709043] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 796.709159] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 796.709270] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 796.709388] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 796.709489] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 796.709630] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 796.730948] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 796.731153] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 796.731370] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 796.731532] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-413" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.731864] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-5e1c11d7-9069-43ec-8135-0682b4d7d9f9 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.732051] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-5e1c11d7-9069-43ec-8135-0682b4d7d9f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.732241] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-5e1c11d7-9069-43ec-8135-0682b4d7d9f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.732716] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-5e1c11d7-9069-43ec-8135-0682b4d7d9f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.732841] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e1c11d7-9069-43ec-8135-0682b4d7d9f9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.791404] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb in Status: SUCCESS [ 796.792220] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.792220] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.792220] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.792370] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.792507] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.792567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.792724] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.793155] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.793155] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.793155] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.902021] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.902234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.902710] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.902710] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.902710] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.903572] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.903572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.903572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.903572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.903572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.903572] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 already deleted. [ 796.903572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.235262] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.235548] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.235729] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.236154] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.236437] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.236716] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 5e1c11d7-9069-43ec-8135-0682b4d7d9f9 not found, creating... [ 797.237176] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.237466] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.237663] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.238059] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.238312] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.238691] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.238888] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.239073] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.239324] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.239559] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.239820] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 5e1c11d7-9069-43ec-8135-0682b4d7d9f9 is going to be created. [ 797.264249] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.265015] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.265015] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.265015] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.265201] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.265453] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-5e1c11d7-9069-43ec-8135-0682b4d7d9f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.297233] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.297484] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.297600] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.297883] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.298134] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.298312] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.298407] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.298679] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.298802] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.298951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.300827] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.300827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.300827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.300990] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.301171] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.301302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.301364] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.301591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.301693] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.301753] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.301850] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.805282] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f8bd1f0-245d-4d6b-8841-4e7773984ffb: rpc.has_security_group_logging(os_id): False [ 797.829843] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.829924] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.830266] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.830409] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.830984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.831077] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.831458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.831458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.831458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.831836] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.831836] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.831836] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.832042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.832042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.832139] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.832659] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.832659] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.832659] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.832659] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.832659] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.833184] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb is going to be created. [ 797.905524] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.906168] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.906461] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.906818] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.907152] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.920567] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb in Status: IN_PROGRESS for 2s [ 797.991731] env[69920]: INFO networking_nsxv3.common.synchronization [req-1c0e1eab-db14-4069-bb96-b7700759b7fd req-00bc6e28-db4b-4adc-b953-849fc08f7e42 service nova] Enqueued Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_rules [ 797.992012] env[69920]: INFO networking_nsxv3.common.synchronization [req-1c0e1eab-db14-4069-bb96-b7700759b7fd req-00bc6e28-db4b-4adc-b953-849fc08f7e42 service nova] Enqueued Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 797.992166] env[69920]: INFO networking_nsxv3.common.synchronization [req-1c0e1eab-db14-4069-bb96-b7700759b7fd req-00bc6e28-db4b-4adc-b953-849fc08f7e42 service nova] Enqueued Resource ID: 5e1c11d7-9069-43ec-8135-0682b4d7d9f9 with Priority: HIGHEST for action port [ 797.992809] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_rules [ 797.992964] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 797.993384] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e1c11d7-9069-43ec-8135-0682b4d7d9f9 with Priority: HIGHEST for action port [ 797.993942] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.994153] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.994292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.994628] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.994767] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.995829] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.999022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.999022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.999022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.999022] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.999022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.999022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.999022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.999022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.999022] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.999022] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e1c11d7-9069-43ec-8135-0682b4d7d9f9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.999022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e1c11d7-9069-43ec-8135-0682b4d7d9f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.999022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e1c11d7-9069-43ec-8135-0682b4d7d9f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.999022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e1c11d7-9069-43ec-8135-0682b4d7d9f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.999022] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e1c11d7-9069-43ec-8135-0682b4d7d9f9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.184558] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3cdaff7-e960-4617-83ae-85aa804dab73 in Status: SUCCESS [ 798.184911] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.501323] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.502776] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.503015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.505975] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e1c11d7-9069-43ec-8135-0682b4d7d9f9 with status ACTIVE [ 798.505975] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.505975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.505975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.505975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.505975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.505975] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.505975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.505975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.505975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.505975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.505975] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.505975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.505975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.505975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.505975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.505975] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e1c11d7-9069-43ec-8135-0682b4d7d9f9 is going to be updated. [ 798.529011] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.529227] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.529227] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.529443] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.529614] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.529771] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e1c11d7-9069-43ec-8135-0682b4d7d9f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.007555] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.244474] env[69920]: INFO networking_nsxv3.common.synchronization [req-1c0e1eab-db14-4069-bb96-b7700759b7fd req-e87f9715-c640-458d-bef4-da5d02b15dce tempest-MultipleCreateTestJSON-1096518746 tempest-MultipleCreateTestJSON-1096518746-project-member] Enqueued Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 799.244995] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 799.245304] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.245431] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.511265] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.511265] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.511700] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.511700] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.511700] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.511858] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 is going to be created. [ 799.562028] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.562028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.562028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.562585] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.562585] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.576160] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: UNINITIALIZED for 2s [ 799.636690] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-413 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.636910] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-413" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.637051] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-413" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.637330] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-413" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.637596] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.637752] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.637870] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.639371] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.639636] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.639904] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 799.640060] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 799.640214] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 799.640414] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 799.641245] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 799.641430] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 799.641605] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 799.667885] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 799.667885] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 799.668055] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 799.669041] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-413" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.669041] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-21102681-d376-4436-a4e3-250936a48728 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.669273] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-21102681-d376-4436-a4e3-250936a48728" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.669337] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-21102681-d376-4436-a4e3-250936a48728" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.669642] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-21102681-d376-4436-a4e3-250936a48728" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.669811] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21102681-d376-4436-a4e3-250936a48728',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.938108] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb in Status: SUCCESS [ 799.938361] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.172605] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.172937] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.172937] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.173190] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.173435] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.173580] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 21102681-d376-4436-a4e3-250936a48728 not found, creating... [ 800.174041] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.174164] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.174324] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.176414] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.176414] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.176414] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.176414] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.176414] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.176414] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.176414] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.176414] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 21102681-d376-4436-a4e3-250936a48728 is going to be created. [ 800.206766] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.208906] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.208906] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.208906] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.208906] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.208906] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-21102681-d376-4436-a4e3-250936a48728" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.144981] env[69920]: INFO networking_nsxv3.common.synchronization [req-1c0e1eab-db14-4069-bb96-b7700759b7fd req-e961089d-73cf-41ac-83c9-c7180f98414a service nova] Enqueued Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_rules [ 801.146291] env[69920]: INFO networking_nsxv3.common.synchronization [req-1c0e1eab-db14-4069-bb96-b7700759b7fd req-e961089d-73cf-41ac-83c9-c7180f98414a service nova] Enqueued Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 801.146291] env[69920]: INFO networking_nsxv3.common.synchronization [req-1c0e1eab-db14-4069-bb96-b7700759b7fd req-e961089d-73cf-41ac-83c9-c7180f98414a service nova] Enqueued Resource ID: 21102681-d376-4436-a4e3-250936a48728 with Priority: HIGHEST for action port [ 801.149490] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_rules [ 801.149490] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 801.149490] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21102681-d376-4436-a4e3-250936a48728 with Priority: HIGHEST for action port [ 801.149490] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.149490] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.149490] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.149490] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.149490] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-21102681-d376-4436-a4e3-250936a48728 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.149490] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21102681-d376-4436-a4e3-250936a48728" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.149490] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21102681-d376-4436-a4e3-250936a48728" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.149490] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21102681-d376-4436-a4e3-250936a48728" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.149490] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21102681-d376-4436-a4e3-250936a48728',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.588819] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: SUCCESS [ 801.588819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.588819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.588819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.588819] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.589325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.589325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.589325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.589325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.589325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.589464] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.590328] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.590414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.590520] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.590620] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.590685] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.590823] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.590899] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.590986] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.655582] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21102681-d376-4436-a4e3-250936a48728 with status ACTIVE [ 801.655582] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.655582] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.655582] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.655582] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.655582] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.655582] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.655945] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.656750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.656750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.656750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.656750] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.656750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.656750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.657039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.657174] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.657314] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21102681-d376-4436-a4e3-250936a48728 is going to be updated. [ 801.680896] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.681097] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.681160] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.681374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.681518] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.681696] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21102681-d376-4436-a4e3-250936a48728" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.092538] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.096925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.096925] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.599529] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.101953] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.101953] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.102256] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.102364] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.102491] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.102575] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 is going to be updated. [ 803.134708] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.135032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.135032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.135354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.135566] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.145254] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: IN_PROGRESS for 2s [ 803.473021] env[69920]: INFO networking_nsxv3.common.synchronization [req-5a92074e-bdb4-431d-a11e-a1d0c051c00e req-c75b35dd-25b1-4686-8f79-b80d3df55e45 tempest-ServersAdminTestJSON-859816448 tempest-ServersAdminTestJSON-859816448-project-member] Enqueued Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 803.473021] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 803.473021] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.473021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.473021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.473021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.473021] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.473021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.473021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.473416] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.473416] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.473416] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.658084] env[69920]: INFO networking_nsxv3.common.synchronization [req-adfe37e0-81fd-4891-a7ae-8fb3171f84d4 req-df6878a8-319e-4451-9f48-d4a96eae0b0b tempest-ServerGroupTestJSON-635802753 tempest-ServerGroupTestJSON-635802753-project-member] Enqueued Resource ID: b3cdaff7-e960-4617-83ae-85aa804dab73 with Priority: HIGHEST for action security_group_members [ 803.659190] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3cdaff7-e960-4617-83ae-85aa804dab73 with Priority: HIGHEST for action security_group_members [ 803.659680] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3cdaff7-e960-4617-83ae-85aa804dab73 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.659961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.660260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.660657] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.660964] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.661240] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.662022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.662022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.662022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.662022] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3cdaff7-e960-4617-83ae-85aa804dab73',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.824790] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-613 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.824999] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-613" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.825594] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-613" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.825950] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-613" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.826637] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.826934] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.826987] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.827489] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.827656] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.827873] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 803.827992] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 803.828595] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 803.828729] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 803.828856] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 803.828971] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 803.829123] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 803.849686] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 803.849864] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 803.850008] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 803.850258] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-613" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.850510] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-85825835-357a-42a3-81f4-b55d7e165b65 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.850684] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-85825835-357a-42a3-81f4-b55d7e165b65" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.850816] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-85825835-357a-42a3-81f4-b55d7e165b65" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.852019] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-85825835-357a-42a3-81f4-b55d7e165b65" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.852019] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85825835-357a-42a3-81f4-b55d7e165b65',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.980248] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.980248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.980248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.980248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.980248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.980248] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.980248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.980248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.980248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.980248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.980248] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a already deleted. [ 803.980248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.167024] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.167024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.167024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.167024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.167024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.167024] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.167024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.167024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.167024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.167024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.167024] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3cdaff7-e960-4617-83ae-85aa804dab73 is going to be updated. [ 804.205567] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.205936] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.206124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.206520] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.206797] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.217375] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3cdaff7-e960-4617-83ae-85aa804dab73 in Status: IN_PROGRESS for 2s [ 804.353915] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.354355] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.354493] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.354955] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.355162] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.355361] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 85825835-357a-42a3-81f4-b55d7e165b65 not found, creating... [ 804.355812] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.356008] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.356238] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.356699] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.356771] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.357832] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.358007] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.358198] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.358410] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.358556] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.358728] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 85825835-357a-42a3-81f4-b55d7e165b65 is going to be created. [ 804.382235] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.382235] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.382235] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.382235] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.382235] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.382493] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-85825835-357a-42a3-81f4-b55d7e165b65" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.128056] env[69920]: INFO networking_nsxv3.common.synchronization [req-5a92074e-bdb4-431d-a11e-a1d0c051c00e req-882078e7-92d4-407e-a756-32df8186e80d service nova] Enqueued Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_rules [ 805.128056] env[69920]: INFO networking_nsxv3.common.synchronization [req-5a92074e-bdb4-431d-a11e-a1d0c051c00e req-882078e7-92d4-407e-a756-32df8186e80d service nova] Enqueued Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 805.128056] env[69920]: INFO networking_nsxv3.common.synchronization [req-5a92074e-bdb4-431d-a11e-a1d0c051c00e req-882078e7-92d4-407e-a756-32df8186e80d service nova] Enqueued Resource ID: 85825835-357a-42a3-81f4-b55d7e165b65 with Priority: HIGHEST for action port [ 805.128056] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_rules [ 805.128056] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 805.128056] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85825835-357a-42a3-81f4-b55d7e165b65 with Priority: HIGHEST for action port [ 805.128056] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.128056] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.128056] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.128867] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.128937] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.129915] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.129968] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.130040] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.130219] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.130384] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.130488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.130548] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.130694] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.130774] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.130860] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.131652] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-85825835-357a-42a3-81f4-b55d7e165b65 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.131750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85825835-357a-42a3-81f4-b55d7e165b65" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.131812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85825835-357a-42a3-81f4-b55d7e165b65" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.133214] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85825835-357a-42a3-81f4-b55d7e165b65" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.133769] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85825835-357a-42a3-81f4-b55d7e165b65',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.156398] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: SUCCESS [ 805.156591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.156773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.157467] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.157467] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.157467] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.157467] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.157718] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.157718] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.157718] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.640619] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 85825835-357a-42a3-81f4-b55d7e165b65 with status ACTIVE [ 805.640619] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.640619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.640619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.640619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.640619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.640619] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.640619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.640619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.640619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.640619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.640619] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.640619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.640619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.640619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.640619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.640619] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 85825835-357a-42a3-81f4-b55d7e165b65 is going to be updated. [ 805.641853] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.643108] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.643342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.660057] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.667206] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.667381] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.667530] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.667829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.668027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.668474] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85825835-357a-42a3-81f4-b55d7e165b65" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.146432] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.163469] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.238414] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3cdaff7-e960-4617-83ae-85aa804dab73 in Status: SUCCESS [ 806.238631] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3cdaff7-e960-4617-83ae-85aa804dab73 deletion is rescheduled due to dependency. [ 806.238922] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3cdaff7-e960-4617-83ae-85aa804dab73" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.648917] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.649137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.649200] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.649433] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.649545] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.649651] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a is going to be created. [ 806.666087] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.666254] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.666324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.666542] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.666635] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.666731] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 is going to be updated. [ 806.679490] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.679719] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.679819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.680084] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.680328] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.691759] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: UNINITIALIZED for 2s [ 806.701820] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.701976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.701976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.702199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.702412] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.714673] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: IN_PROGRESS for 2s [ 808.710359] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: SUCCESS [ 808.710718] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.710855] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.711118] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.711361] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.711513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.711597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.711820] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.711982] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.712103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.712225] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.724293] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: SUCCESS [ 808.724481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.724720] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.724957] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.725158] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.725329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.725444] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.725712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.725820] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.725913] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.726095] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.726197] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.726257] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.726398] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.726538] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.726644] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.726680] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.726846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.726890] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.726934] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.727411] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.215794] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.215794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.215794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.215794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.216189] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.216189] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.216189] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.216313] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.216313] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.216497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.216576] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.216658] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.216705] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.216919] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.217072] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.217191] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.217829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.217829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.217829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.217829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.217829] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.231171] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48d70a54-3f5c-40ef-9cc4-f5d82c01a717: rpc.has_security_group_logging(os_id): False [ 809.252653] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.253142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.253142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.253142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.253408] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.253545] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.253656] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.253765] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.254071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.254219] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.254612] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.254766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.254872] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.256043] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.256043] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.256272] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.256435] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.257054] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.257054] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.257054] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.257054] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 is going to be created. [ 809.346666] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.346666] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.346666] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.346666] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.347100] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.395696] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: IN_PROGRESS for 2s [ 809.720238] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 154896d4-d0bc-49e9-8d89-5fcc04260b1a: rpc.has_security_group_logging(os_id): False [ 809.756345] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.756534] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.756637] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.756946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.757086] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.757348] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.757488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.757578] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.757791] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.757909] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.758218] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.758360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.758453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.758663] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.758782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.759051] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.759194] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.759290] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.759492] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.759610] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.759742] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a is going to be created. [ 809.899321] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.899472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.899520] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.899718] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.899901] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.915254] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: IN_PROGRESS for 2s [ 810.130753] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 810.130753] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 811.409728] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: SUCCESS [ 811.410067] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.410143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.410374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.410469] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.737854] env[69920]: INFO networking_nsxv3.common.synchronization [req-30d82a6d-aadd-4127-a20b-06e5ad238918 req-2c68e566-c8a0-47bf-b244-a4b049c6b191 tempest-MultipleCreateTestJSON-1096518746 tempest-MultipleCreateTestJSON-1096518746-project-member] Enqueued Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 811.738351] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 811.738864] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.738864] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.738864] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.739430] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.739430] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.739612] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.739734] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.739934] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.740103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.740270] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.895446] env[69920]: INFO networking_nsxv3.common.synchronization [req-d73c346e-2e36-4bff-a5af-4aee29d7c15c req-b9f837ed-1596-4bd6-b941-bc0ad2df6728 tempest-MultipleCreateTestJSON-1096518746 tempest-MultipleCreateTestJSON-1096518746-project-member] Enqueued Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 811.896417] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 811.896737] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.896864] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.913554] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.913740] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.930977] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: SUCCESS [ 811.931412] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.242741] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.744947] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.247556] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.247724] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.247832] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.248073] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.248236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.248288] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 is going to be updated. [ 813.280918] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.280918] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.281138] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.281346] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.281522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.292020] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: IN_PROGRESS for 2s [ 814.519049] env[69920]: INFO networking_nsxv3.common.synchronization [req-b84c3127-a21f-46ff-9353-58dba1752723 req-dc9dc500-52a0-40e4-abc9-28839185ea87 tempest-ListImageFiltersTestJSON-1014675120 tempest-ListImageFiltersTestJSON-1014675120-project-member] Enqueued Resource ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f with Priority: HIGHEST for action security_group_members [ 814.519415] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f with Priority: HIGHEST for action security_group_members [ 814.520259] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.520429] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.520516] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.520834] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.521040] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.521172] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.521306] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.521457] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.521559] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.521687] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.023897] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.306262] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: SUCCESS [ 815.306553] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.306754] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.307198] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.307299] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.307420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.307486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.307640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.307755] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.307844] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.528729] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.811086] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.811289] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.811329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.811542] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.811641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.811835] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.811936] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.811994] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.812266] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.812266] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.812416] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 is going to be updated. [ 815.841466] env[69920]: INFO networking_nsxv3.common.synchronization [req-dfa4e4a6-ed70-41a2-aba8-7468a56f257d req-0a0aef53-41cd-4615-a729-b25f25325a6d tempest-ImagesOneServerNegativeTestJSON-924528592 tempest-ImagesOneServerNegativeTestJSON-924528592-project-member] Enqueued Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_members [ 815.842584] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.842727] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.842768] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.843334] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.843334] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.846835] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_members [ 815.846835] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.846835] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.846835] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.846835] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.846835] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.846835] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.846835] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.846835] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.846835] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.846835] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.859662] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: IN_PROGRESS for 2s [ 816.031060] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.031233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.031315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.031535] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.031639] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.031742] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f is going to be updated. [ 816.065183] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.065332] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.065423] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.065631] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.065798] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.076785] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f in Status: IN_PROGRESS for 2s [ 816.349045] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.349223] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.349261] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.349527] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.349675] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.349919] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.350086] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.350174] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.350423] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.350569] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.350675] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb is going to be updated. [ 816.390256] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.390449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.390539] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.390796] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.390969] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.402638] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb in Status: IN_PROGRESS for 2s [ 816.994785] env[69920]: INFO networking_nsxv3.common.synchronization [req-c6070f6e-85ea-41b9-b4c4-ac6ea0c0d353 req-4ab8a738-28f5-4fc9-ae31-af1706fb166d tempest-ServersAdminTestJSON-859816448 tempest-ServersAdminTestJSON-859816448-project-member] Enqueued Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 816.995231] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 816.995463] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.995601] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.995656] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.995905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.996133] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.996244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.996306] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.996464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.996551] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.996644] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.499934] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.548022] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-613 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.548022] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-613" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.548022] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-613" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.548022] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-613" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.548022] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.548022] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.548022] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.548022] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.548022] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.548022] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 817.548022] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 817.548022] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 817.548854] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 817.548854] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 817.548854] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 817.548854] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 817.570314] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 817.570492] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 817.570634] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 817.570813] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-613" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.571156] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-6337fd25-9a6d-4947-a0dd-1a56aac7beb3 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.571549] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-6337fd25-9a6d-4947-a0dd-1a56aac7beb3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.571549] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-6337fd25-9a6d-4947-a0dd-1a56aac7beb3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.571777] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-6337fd25-9a6d-4947-a0dd-1a56aac7beb3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.571920] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6337fd25-9a6d-4947-a0dd-1a56aac7beb3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.870862] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: SUCCESS [ 817.870862] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 deletion is rescheduled due to dependency. [ 817.870862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.871098] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.871263] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.871467] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.871578] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.871639] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.871795] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.871873] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.871959] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.872059] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.003618] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.075524] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.075864] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.076055] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.076426] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.076618] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.076782] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 6337fd25-9a6d-4947-a0dd-1a56aac7beb3 not found, creating... [ 818.077121] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.077313] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.077453] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.077705] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.077881] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.078221] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.078397] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.078519] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.078739] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.078908] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.079069] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 6337fd25-9a6d-4947-a0dd-1a56aac7beb3 is going to be created. [ 818.092106] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f in Status: SUCCESS [ 818.092547] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.130484] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.130746] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.130851] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.131323] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.131606] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.131912] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-6337fd25-9a6d-4947-a0dd-1a56aac7beb3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.375567] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.375701] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.375797] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.376083] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.376304] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.376481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.376481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.376635] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.376723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.376811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.376956] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.377057] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.377113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.377254] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.377388] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.377480] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.377535] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.377683] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.377747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.377823] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.377910] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.412795] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb in Status: SUCCESS [ 818.412946] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb deletion is rescheduled due to dependency. [ 818.413061] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.507027] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.507259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.507621] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.507893] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.507992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.508110] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a is going to be updated. [ 818.541888] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.542117] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.542201] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.542416] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.542566] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.553391] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: IN_PROGRESS for 2s [ 818.880029] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48d70a54-3f5c-40ef-9cc4-f5d82c01a717: rpc.has_security_group_logging(os_id): False [ 818.911068] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.911248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.911323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.911540] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.911634] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.912298] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.912298] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.912298] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.912298] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.912298] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.913031] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.913031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.913031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.913031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.913031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.913347] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.913347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.913347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.913490] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.913536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.913614] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 is going to be updated. [ 818.998589] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.998810] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.998929] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.999289] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.999546] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.022503] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: IN_PROGRESS for 2s [ 819.033482] env[69920]: INFO networking_nsxv3.common.synchronization [req-c6070f6e-85ea-41b9-b4c4-ac6ea0c0d353 req-2f7020fc-e2f3-4005-bb0b-a54d9b0a8f01 service nova] Enqueued Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_rules [ 819.033665] env[69920]: INFO networking_nsxv3.common.synchronization [req-c6070f6e-85ea-41b9-b4c4-ac6ea0c0d353 req-2f7020fc-e2f3-4005-bb0b-a54d9b0a8f01 service nova] Enqueued Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 819.033804] env[69920]: INFO networking_nsxv3.common.synchronization [req-c6070f6e-85ea-41b9-b4c4-ac6ea0c0d353 req-2f7020fc-e2f3-4005-bb0b-a54d9b0a8f01 service nova] Enqueued Resource ID: 6337fd25-9a6d-4947-a0dd-1a56aac7beb3 with Priority: HIGHEST for action port [ 819.034033] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_rules [ 819.034177] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 819.034256] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6337fd25-9a6d-4947-a0dd-1a56aac7beb3 with Priority: HIGHEST for action port [ 819.035662] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.035802] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.036035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.036345] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.036488] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.037658] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.037753] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.041021] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-6337fd25-9a6d-4947-a0dd-1a56aac7beb3 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.041021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6337fd25-9a6d-4947-a0dd-1a56aac7beb3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.041021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6337fd25-9a6d-4947-a0dd-1a56aac7beb3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.041021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6337fd25-9a6d-4947-a0dd-1a56aac7beb3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.041021] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6337fd25-9a6d-4947-a0dd-1a56aac7beb3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.541398] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.541398] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.541564] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6337fd25-9a6d-4947-a0dd-1a56aac7beb3 with status ACTIVE [ 819.543567] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.543567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.543567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.543567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.543567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.543567] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.543567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.543567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.543567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.543567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.543567] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.543567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.543567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.543567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.543567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.543567] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6337fd25-9a6d-4947-a0dd-1a56aac7beb3 is going to be updated. [ 819.575678] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.575678] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.575678] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.575678] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.575678] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.575678] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6337fd25-9a6d-4947-a0dd-1a56aac7beb3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.763787] env[69920]: INFO networking_nsxv3.common.synchronization [req-9b402e84-30d0-416a-8258-1ab805df91d8 req-aa43ee44-9d98-4022-9c6a-ac459edec7b4 tempest-FloatingIPsAssociationTestJSON-1358918757 tempest-FloatingIPsAssociationTestJSON-1358918757-project-member] Enqueued Resource ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd with Priority: HIGHEST for action security_group_members [ 819.764376] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd with Priority: HIGHEST for action security_group_members [ 819.765030] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-40f3bd9f-8637-49e8-92cd-03812c846cfd taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.765030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.765030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.765442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.766182] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.766182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.766182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.766182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.766182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.767176] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.235387] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.235719] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-668" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.235901] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-668" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.236809] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-668" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.236809] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.237236] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.237276] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.237527] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.237656] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.237895] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 820.238025] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 820.238141] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 820.238251] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 820.238366] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 820.238475] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 820.238612] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 820.259113] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 820.259299] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 820.259441] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 820.259620] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-668" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.260693] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-9db3f0b7-d302-466d-93ae-16dcd9a9f682 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.260693] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-9db3f0b7-d302-466d-93ae-16dcd9a9f682" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.260693] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-9db3f0b7-d302-466d-93ae-16dcd9a9f682" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.260913] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-9db3f0b7-d302-466d-93ae-16dcd9a9f682" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.260913] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9db3f0b7-d302-466d-93ae-16dcd9a9f682',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.268624] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.574340] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: SUCCESS [ 820.574561] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.574766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.574989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.575188] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.575305] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.575371] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.575530] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.575621] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.576143] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.764998] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.765253] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.765420] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.765755] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.765889] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.766074] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 9db3f0b7-d302-466d-93ae-16dcd9a9f682 not found, creating... [ 820.767099] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.767099] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.767099] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.767099] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.767099] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.767319] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.768031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.768031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.768031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.768031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.768235] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 9db3f0b7-d302-466d-93ae-16dcd9a9f682 is going to be created. [ 820.770115] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.793892] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.793892] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.794062] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.795478] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.795478] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.795478] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-9db3f0b7-d302-466d-93ae-16dcd9a9f682" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.042901] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: SUCCESS [ 821.043168] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.077932] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.271986] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.272364] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.272364] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.272496] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.272549] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.272661] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd is going to be updated. [ 821.307533] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.307688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.307688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.307926] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.308095] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.318102] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd in Status: IN_PROGRESS for 2s [ 821.580364] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.625833] env[69920]: INFO networking_nsxv3.common.synchronization [req-9b402e84-30d0-416a-8258-1ab805df91d8 req-1923b780-4783-418f-9097-77ec5ab9b0b8 service nova] Enqueued Resource ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd with Priority: HIGHEST for action security_group_rules [ 821.626081] env[69920]: INFO networking_nsxv3.common.synchronization [req-9b402e84-30d0-416a-8258-1ab805df91d8 req-1923b780-4783-418f-9097-77ec5ab9b0b8 service nova] Enqueued Resource ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd with Priority: HIGHEST for action security_group_members [ 821.626304] env[69920]: INFO networking_nsxv3.common.synchronization [req-9b402e84-30d0-416a-8258-1ab805df91d8 req-1923b780-4783-418f-9097-77ec5ab9b0b8 service nova] Enqueued Resource ID: 9db3f0b7-d302-466d-93ae-16dcd9a9f682 with Priority: HIGHEST for action port [ 821.627948] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd with Priority: HIGHEST for action security_group_rules [ 821.628223] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd with Priority: HIGHEST for action security_group_members [ 821.628283] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9db3f0b7-d302-466d-93ae-16dcd9a9f682 with Priority: HIGHEST for action port [ 821.628991] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40f3bd9f-8637-49e8-92cd-03812c846cfd taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.629165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.629265] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.629517] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.629623] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.632030] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-40f3bd9f-8637-49e8-92cd-03812c846cfd taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.632030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.632030] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-9db3f0b7-d302-466d-93ae-16dcd9a9f682 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.632030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9db3f0b7-d302-466d-93ae-16dcd9a9f682" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.632030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9db3f0b7-d302-466d-93ae-16dcd9a9f682" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.632030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9db3f0b7-d302-466d-93ae-16dcd9a9f682" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.632030] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9db3f0b7-d302-466d-93ae-16dcd9a9f682',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.087825] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.087825] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.087825] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.088101] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.088101] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.088169] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a is going to be updated. [ 822.118555] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.118720] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.118720] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.118921] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.119084] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.127929] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: IN_PROGRESS for 2s [ 822.133393] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-40f3bd9f-8637-49e8-92cd-03812c846cfd taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.133569] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.133670] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9db3f0b7-d302-466d-93ae-16dcd9a9f682 with status ACTIVE [ 822.133844] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.133942] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.133993] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.134195] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.134409] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.134478] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.134524] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.134609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.134793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.134876] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.135069] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.135165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.135224] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.135356] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.135433] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.135516] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9db3f0b7-d302-466d-93ae-16dcd9a9f682 is going to be updated. [ 822.159183] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.159183] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.159183] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.159183] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.159183] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.159822] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9db3f0b7-d302-466d-93ae-16dcd9a9f682" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.287191] env[69920]: INFO networking_nsxv3.common.synchronization [req-2e4953a7-7cdc-4724-9f99-4c0618d11019 req-20aa7e08-0a47-4fad-b931-9f4d4a8012aa tempest-AttachInterfacesTestJSON-901858583 tempest-AttachInterfacesTestJSON-901858583-project-member] Enqueued Resource ID: 82051f94-9eeb-470d-aa42-9e827049069f with Priority: HIGHEST for action security_group_members [ 822.287782] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82051f94-9eeb-470d-aa42-9e827049069f with Priority: HIGHEST for action security_group_members [ 822.288391] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-82051f94-9eeb-470d-aa42-9e827049069f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.288532] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.288567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.288831] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.288997] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.289112] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.289176] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.289345] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.289436] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.289534] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82051f94-9eeb-470d-aa42-9e827049069f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.606330] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.606639] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.606866] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.607590] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.608042] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.608324] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.608531] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.608896] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.609140] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.609463] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 822.609656] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 822.609846] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 822.610058] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 822.610258] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 822.610446] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 822.610667] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 822.630636] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 822.630883] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 822.631014] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 822.631254] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.631708] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-ef273cd9-400b-409d-b689-297040f2ca04 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.631977] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-ef273cd9-400b-409d-b689-297040f2ca04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.631977] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-ef273cd9-400b-409d-b689-297040f2ca04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.632319] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-ef273cd9-400b-409d-b689-297040f2ca04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.632459] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef273cd9-400b-409d-b689-297040f2ca04',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.792014] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.792174] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.792245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.792455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.792564] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.792835] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.792959] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.793035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.793204] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.793283] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.793366] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82051f94-9eeb-470d-aa42-9e827049069f already deleted. [ 822.793442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.140039] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.140039] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.140159] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.140501] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.140752] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.140981] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port ef273cd9-400b-409d-b689-297040f2ca04 not found, creating... [ 823.141373] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.141569] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.142119] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.142567] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.142781] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.143165] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.143414] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.143565] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.143903] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.144157] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.144391] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: ef273cd9-400b-409d-b689-297040f2ca04 is going to be created. [ 823.194846] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.195181] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.195239] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.195534] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.196053] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.199655] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-ef273cd9-400b-409d-b689-297040f2ca04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.335027] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd in Status: SUCCESS [ 823.335027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.335027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.335027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.335027] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.335027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.335027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.335027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.335027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.335027] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.843353] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.092963] env[69920]: INFO networking_nsxv3.common.synchronization [req-2e4953a7-7cdc-4724-9f99-4c0618d11019 req-84a8604c-524e-48ee-82f5-b7391c77188a service nova] Enqueued Resource ID: 82051f94-9eeb-470d-aa42-9e827049069f with Priority: HIGHEST for action security_group_rules [ 824.093158] env[69920]: INFO networking_nsxv3.common.synchronization [req-2e4953a7-7cdc-4724-9f99-4c0618d11019 req-84a8604c-524e-48ee-82f5-b7391c77188a service nova] Enqueued Resource ID: 82051f94-9eeb-470d-aa42-9e827049069f with Priority: HIGHEST for action security_group_members [ 824.093305] env[69920]: INFO networking_nsxv3.common.synchronization [req-2e4953a7-7cdc-4724-9f99-4c0618d11019 req-84a8604c-524e-48ee-82f5-b7391c77188a service nova] Enqueued Resource ID: ef273cd9-400b-409d-b689-297040f2ca04 with Priority: HIGHEST for action port [ 824.094361] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82051f94-9eeb-470d-aa42-9e827049069f with Priority: HIGHEST for action security_group_rules [ 824.094361] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82051f94-9eeb-470d-aa42-9e827049069f with Priority: HIGHEST for action security_group_members [ 824.094361] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef273cd9-400b-409d-b689-297040f2ca04 with Priority: HIGHEST for action port [ 824.096571] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82051f94-9eeb-470d-aa42-9e827049069f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.096571] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.096571] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.096571] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.096571] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82051f94-9eeb-470d-aa42-9e827049069f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.096571] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-82051f94-9eeb-470d-aa42-9e827049069f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.096571] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.096571] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.096571] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.096571] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.096571] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.096971] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.096971] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.096971] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.096971] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82051f94-9eeb-470d-aa42-9e827049069f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.098596] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef273cd9-400b-409d-b689-297040f2ca04 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.098596] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef273cd9-400b-409d-b689-297040f2ca04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.098596] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef273cd9-400b-409d-b689-297040f2ca04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.098596] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef273cd9-400b-409d-b689-297040f2ca04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.098596] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef273cd9-400b-409d-b689-297040f2ca04',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.137838] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: IN_PROGRESS for 4s [ 824.346399] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.599807] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('82051f94-9eeb-470d-aa42-9e827049069f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.600847] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-82051f94-9eeb-470d-aa42-9e827049069f taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.600960] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.606187] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef273cd9-400b-409d-b689-297040f2ca04 with status ACTIVE [ 824.606187] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.606187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.606187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.606187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.606187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.606187] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.606187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.606187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.606187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.606187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.606187] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.606187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.606187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.606187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.606187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.606187] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef273cd9-400b-409d-b689-297040f2ca04 is going to be updated. [ 824.630449] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.630449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.630449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.630449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.630449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.630449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef273cd9-400b-409d-b689-297040f2ca04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.850236] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.850236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.850236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.850236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.850236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.850236] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd is going to be updated. [ 824.893845] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.893845] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.893845] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.893845] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.893845] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.902185] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd in Status: IN_PROGRESS for 2s [ 825.103837] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('82051f94-9eeb-470d-aa42-9e827049069f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.608197] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.608581] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.608581] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.608696] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.608744] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.608838] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82051f94-9eeb-470d-aa42-9e827049069f is going to be created. [ 825.638519] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.638921] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.638921] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.639333] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.639333] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.651895] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82051f94-9eeb-470d-aa42-9e827049069f in Status: UNINITIALIZED for 2s [ 826.123689] env[69920]: INFO networking_nsxv3.common.synchronization [req-0209d100-8336-4340-8848-82e1fb52c45f req-59808651-4eec-4f6b-b68b-534ddced6bab tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 826.124390] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 826.124750] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.124888] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.124954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.125389] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.125553] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.125660] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.125748] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.125938] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.126039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.126140] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.152913] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: SUCCESS [ 826.153144] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.153496] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.153603] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.153823] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.154029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.154188] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.155594] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.155594] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.155594] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.155594] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.500048] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-331 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.500048] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-331" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.500048] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-331" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.500048] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-331" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.500048] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.500048] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.500718] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.502591] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.505023] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.505023] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 826.505023] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 826.505023] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 826.505023] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 826.505023] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 826.505023] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 826.505023] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 826.524414] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 826.524594] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 826.524809] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 826.525019] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-331" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.525351] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-efc77bd5-a980-4a4e-9211-70184239a8ee taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.525519] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-efc77bd5-a980-4a4e-9211-70184239a8ee" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.525691] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-efc77bd5-a980-4a4e-9211-70184239a8ee" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.526026] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-efc77bd5-a980-4a4e-9211-70184239a8ee" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.526173] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efc77bd5-a980-4a4e-9211-70184239a8ee',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.628321] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.628701] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.628701] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.628811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.628862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.629020] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.629113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.629173] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.629323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.629397] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.629695] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 already deleted. [ 826.629695] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.657503] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.657732] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.657732] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.657943] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.658123] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.658226] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.658292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.658448] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.658538] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.658626] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.658793] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.658888] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.658949] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.659120] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.659256] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.659351] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.659411] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.659559] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.659637] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.659721] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.659812] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.914595] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd in Status: SUCCESS [ 826.914595] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.914745] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.914961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.915172] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.915627] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.915862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.916085] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.916188] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.916299] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.916421] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.030419] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.030419] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.030419] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.030419] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.030805] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.030805] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port efc77bd5-a980-4a4e-9211-70184239a8ee not found, creating... [ 827.032416] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.032416] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.032416] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.032416] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.032416] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.032416] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.032810] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.032810] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.033046] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.033246] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.033406] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: efc77bd5-a980-4a4e-9211-70184239a8ee is going to be created. [ 827.059011] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.059320] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.059498] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.059912] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.060247] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.060599] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-efc77bd5-a980-4a4e-9211-70184239a8ee" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.162640] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 154896d4-d0bc-49e9-8d89-5fcc04260b1a: rpc.has_security_group_logging(os_id): False [ 827.188710] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.188896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.188967] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.189176] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.189265] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.189460] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.189573] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.189637] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.190445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.190445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.190445] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.190445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.190445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.190445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.190896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.195058] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.195058] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.195058] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.195058] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.195058] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.195058] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a is going to be updated. [ 827.278601] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.278881] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.278954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.279295] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.279461] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.307996] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: IN_PROGRESS for 2s [ 827.419578] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-40f3bd9f-8637-49e8-92cd-03812c846cfd taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.419578] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.419783] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.420023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.420290] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.420444] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.420545] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.420791] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.420929] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.421084] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.421311] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-40f3bd9f-8637-49e8-92cd-03812c846cfd taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.421455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.421558] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.421769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.421982] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.422837] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.422936] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.423168] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.423299] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.423435] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.423576] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.669585] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82051f94-9eeb-470d-aa42-9e827049069f in Status: SUCCESS [ 827.669585] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.669585] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.670526] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.672023] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.672023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.672023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.672023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.672023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.672023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.672023] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('82051f94-9eeb-470d-aa42-9e827049069f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.812378] env[69920]: INFO networking_nsxv3.common.synchronization [req-0209d100-8336-4340-8848-82e1fb52c45f req-6f36c08c-9dfd-463a-8214-d71413e5ac29 service nova] Enqueued Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_rules [ 827.812629] env[69920]: INFO networking_nsxv3.common.synchronization [req-0209d100-8336-4340-8848-82e1fb52c45f req-6f36c08c-9dfd-463a-8214-d71413e5ac29 service nova] Enqueued Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 827.812956] env[69920]: INFO networking_nsxv3.common.synchronization [req-0209d100-8336-4340-8848-82e1fb52c45f req-6f36c08c-9dfd-463a-8214-d71413e5ac29 service nova] Enqueued Resource ID: efc77bd5-a980-4a4e-9211-70184239a8ee with Priority: HIGHEST for action port [ 827.815769] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_rules [ 827.815769] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 827.815769] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efc77bd5-a980-4a4e-9211-70184239a8ee with Priority: HIGHEST for action port [ 827.815769] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.815769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.815769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.815769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.816174] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.822719] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.822719] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.822861] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.822976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.823164] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.823260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.823321] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.823470] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.823557] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.823655] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.824635] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-efc77bd5-a980-4a4e-9211-70184239a8ee taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.824850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efc77bd5-a980-4a4e-9211-70184239a8ee" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.824922] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efc77bd5-a980-4a4e-9211-70184239a8ee" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.825091] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efc77bd5-a980-4a4e-9211-70184239a8ee" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.825173] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efc77bd5-a980-4a4e-9211-70184239a8ee',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.926510] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40f3bd9f-8637-49e8-92cd-03812c846cfd: rpc.has_security_group_logging(os_id): False [ 827.946965] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.946965] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.947097] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.947279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.947379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.947613] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.947922] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.947922] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.948022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.948057] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.948265] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.948390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.948390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.948692] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.948692] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.948819] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.948963] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.948963] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.949124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.949209] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.949288] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd is going to be updated. [ 828.058468] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.058468] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.058768] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.058835] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.059472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.080935] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd in Status: IN_PROGRESS for 2s [ 828.174853] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('82051f94-9eeb-470d-aa42-9e827049069f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.327764] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.330642] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.330846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.331145] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port efc77bd5-a980-4a4e-9211-70184239a8ee with status ACTIVE [ 828.331433] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.331611] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.331758] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.337506] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.337506] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.337693] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.337751] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.337781] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.338014] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.338107] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.338375] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.338527] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.338527] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.338650] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.338717] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.338820] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: efc77bd5-a980-4a4e-9211-70184239a8ee is going to be updated. [ 828.369193] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.369359] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.369460] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.369709] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.369852] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.370081] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efc77bd5-a980-4a4e-9211-70184239a8ee" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.678390] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 82051f94-9eeb-470d-aa42-9e827049069f: rpc.has_security_group_logging(os_id): False [ 828.701182] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.701182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.701182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.701182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.701182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.701182] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.701182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.701182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.701182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.701182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.701712] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82051f94-9eeb-470d-aa42-9e827049069f is going to be created. [ 828.801290] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.801514] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.801574] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.801779] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.801976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.816868] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82051f94-9eeb-470d-aa42-9e827049069f in Status: IN_PROGRESS for 2s [ 828.842244] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.145548] env[69920]: INFO networking_nsxv3.common.synchronization [None req-dfaa6e6c-5290-4cee-acf3-e60ee5481e13 None None] Enqueued Resource ID: f2197f57-b3fd-4b70-9908-723af8eea923 with Priority: HIGHEST for action port [ 829.145819] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2197f57-b3fd-4b70-9908-723af8eea923 with Priority: HIGHEST for action port [ 829.146422] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2197f57-b3fd-4b70-9908-723af8eea923 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.146566] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2197f57-b3fd-4b70-9908-723af8eea923" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.146625] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2197f57-b3fd-4b70-9908-723af8eea923" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.146869] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2197f57-b3fd-4b70-9908-723af8eea923" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.146956] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2197f57-b3fd-4b70-9908-723af8eea923',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.324503] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: SUCCESS [ 829.324780] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.343513] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.343713] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.343713] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.343940] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.344045] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.344146] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 is going to be created. [ 829.369832] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.370143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.370221] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.370445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.370609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.381308] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: UNINITIALIZED for 2s [ 829.653652] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f2197f57-b3fd-4b70-9908-723af8eea923 [ 829.654284] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.654284] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.654284] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.654513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.654564] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.654663] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f2197f57-b3fd-4b70-9908-723af8eea923 already deleted. [ 829.655989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2197f57-b3fd-4b70-9908-723af8eea923" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.098983] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd in Status: SUCCESS [ 830.098983] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.832882] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82051f94-9eeb-470d-aa42-9e827049069f in Status: SUCCESS [ 830.832882] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.393557] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: SUCCESS [ 831.393830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.393938] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.394165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.394382] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.394513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.394575] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.394751] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.394848] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.394955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.395060] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.486020] env[69920]: INFO networking_nsxv3.common.synchronization [None req-e8118ce4-8b05-4ee6-8981-a57fdc3da75a None None] Enqueued Resource ID: 628c7c03-c30e-4387-908f-cfbc31a789c4 with Priority: HIGHEST for action port [ 831.486020] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 628c7c03-c30e-4387-908f-cfbc31a789c4 with Priority: HIGHEST for action port [ 831.486020] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-628c7c03-c30e-4387-908f-cfbc31a789c4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.486020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-628c7c03-c30e-4387-908f-cfbc31a789c4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.486020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-628c7c03-c30e-4387-908f-cfbc31a789c4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.486020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-628c7c03-c30e-4387-908f-cfbc31a789c4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.486020] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('628c7c03-c30e-4387-908f-cfbc31a789c4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.900230] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.900543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.900638] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.900905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.901183] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.901356] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.901486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.901716] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.901876] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.902058] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.902292] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.902451] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.902557] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.902901] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.903128] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.903277] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.903329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.903724] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.903724] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.903829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.903937] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.993186] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 628c7c03-c30e-4387-908f-cfbc31a789c4 [ 831.993186] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.993186] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.993186] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.993186] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.993186] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.993457] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:628c7c03-c30e-4387-908f-cfbc31a789c4 already deleted. [ 831.993457] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-628c7c03-c30e-4387-908f-cfbc31a789c4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.408353] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e31e2ae5-2f08-403b-b19a-697a36f3cb16: rpc.has_security_group_logging(os_id): False [ 832.428324] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.428542] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.428542] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.428807] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.428906] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.429121] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.429121] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.429212] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.429336] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.429412] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.429595] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.429695] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.429756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.429983] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.429983] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.430169] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.430264] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.430324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.430464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.430539] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.430623] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 is going to be created. [ 832.498862] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.499021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.499097] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.499308] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.499487] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.516725] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: IN_PROGRESS for 2s [ 832.925172] env[69920]: INFO networking_nsxv3.common.synchronization [req-04fa74e7-e254-4572-a7ca-1f493dd899bb req-6a600d39-f9bd-4107-9841-e0f34666d752 tempest-AttachVolumeNegativeTest-700673554 tempest-AttachVolumeNegativeTest-700673554-project-member] Enqueued Resource ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 with Priority: HIGHEST for action security_group_members [ 832.925172] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 with Priority: HIGHEST for action security_group_members [ 832.925172] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-394b8a58-53d4-4ddb-998c-b2810a22cd53 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.925172] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.925172] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.925172] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.925949] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.926917] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.927148] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.927425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.927612] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.927910] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('394b8a58-53d4-4ddb-998c-b2810a22cd53',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.430570] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.430570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.430570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.431047] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.432088] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.432088] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.432088] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.432088] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.432088] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.432088] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.432088] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 already deleted. [ 833.432680] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.655653] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.655653] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-861" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.655653] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-861" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.655653] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-861" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.655653] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.656425] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.656798] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.657191] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.657885] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.658280] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 833.658559] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 833.658935] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 833.660987] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 833.660987] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 833.660987] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 833.660987] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 833.683563] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 833.683563] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 833.683563] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 833.683563] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-861" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.683563] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-b347a042-35ea-41f5-a96e-84e4553f55d2 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.683563] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-b347a042-35ea-41f5-a96e-84e4553f55d2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.683563] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-b347a042-35ea-41f5-a96e-84e4553f55d2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.683563] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-b347a042-35ea-41f5-a96e-84e4553f55d2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.683563] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b347a042-35ea-41f5-a96e-84e4553f55d2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.189179] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.189271] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.189342] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.189765] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.189765] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.189924] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port b347a042-35ea-41f5-a96e-84e4553f55d2 not found, creating... [ 834.190209] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.190374] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.190492] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.190718] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.190854] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.191187] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.191336] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.191463] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.191662] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.191798] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.191942] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: b347a042-35ea-41f5-a96e-84e4553f55d2 is going to be created. [ 834.222692] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.222936] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.223084] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.223465] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.223711] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.223986] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-b347a042-35ea-41f5-a96e-84e4553f55d2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.531931] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: SUCCESS [ 834.532343] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.147151] env[69920]: INFO networking_nsxv3.common.synchronization [req-04fa74e7-e254-4572-a7ca-1f493dd899bb req-e0f44218-4e34-43b9-834e-4623b4ed2163 service nova] Enqueued Resource ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 with Priority: HIGHEST for action security_group_rules [ 835.147399] env[69920]: INFO networking_nsxv3.common.synchronization [req-04fa74e7-e254-4572-a7ca-1f493dd899bb req-e0f44218-4e34-43b9-834e-4623b4ed2163 service nova] Enqueued Resource ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 with Priority: HIGHEST for action security_group_members [ 835.147548] env[69920]: INFO networking_nsxv3.common.synchronization [req-04fa74e7-e254-4572-a7ca-1f493dd899bb req-e0f44218-4e34-43b9-834e-4623b4ed2163 service nova] Enqueued Resource ID: b347a042-35ea-41f5-a96e-84e4553f55d2 with Priority: HIGHEST for action port [ 835.150908] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 with Priority: HIGHEST for action security_group_rules [ 835.151425] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 with Priority: HIGHEST for action security_group_members [ 835.151594] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b347a042-35ea-41f5-a96e-84e4553f55d2 with Priority: HIGHEST for action port [ 835.152294] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-394b8a58-53d4-4ddb-998c-b2810a22cd53 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.152457] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.152550] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.152809] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.152900] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('394b8a58-53d4-4ddb-998c-b2810a22cd53',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.153831] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-394b8a58-53d4-4ddb-998c-b2810a22cd53 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.153935] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.154022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.154626] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.154826] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.154959] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.155445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.155445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.155445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.155445] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('394b8a58-53d4-4ddb-998c-b2810a22cd53',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.159185] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-b347a042-35ea-41f5-a96e-84e4553f55d2 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.159185] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b347a042-35ea-41f5-a96e-84e4553f55d2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.159185] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b347a042-35ea-41f5-a96e-84e4553f55d2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.159185] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b347a042-35ea-41f5-a96e-84e4553f55d2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.159185] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b347a042-35ea-41f5-a96e-84e4553f55d2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.661128] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-394b8a58-53d4-4ddb-998c-b2810a22cd53 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.661434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.661486] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b347a042-35ea-41f5-a96e-84e4553f55d2 with status ACTIVE [ 835.662022] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.662194] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.662567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.662567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.663931] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.663931] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.663931] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.663931] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.663931] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.663931] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.664218] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.664478] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.664478] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.664607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.664673] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.664826] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b347a042-35ea-41f5-a96e-84e4553f55d2 is going to be updated. [ 835.666321] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('394b8a58-53d4-4ddb-998c-b2810a22cd53',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.690244] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.691017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.691017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.691017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.691017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.691017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b347a042-35ea-41f5-a96e-84e4553f55d2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.171885] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('394b8a58-53d4-4ddb-998c-b2810a22cd53',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.477730] env[69920]: INFO networking_nsxv3.common.synchronization [req-4b821e53-a0eb-445b-83ae-11a479d177ac req-9d651317-9319-4b90-968e-3d9cfea9d674 tempest-ImagesTestJSON-210893687 tempest-ImagesTestJSON-210893687-project-member] Enqueued Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 836.481212] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 836.481894] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.482038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.482107] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.482450] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.482505] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.482583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.482644] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.482836] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.482989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.483077] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.673787] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.674053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.674053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.674197] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.674348] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.674382] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 is going to be created. [ 836.699808] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.699808] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.699808] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.700072] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.702022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.711226] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 in Status: UNINITIALIZED for 2s [ 836.986422] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.986633] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.986734] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.986996] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.987140] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.987382] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.987504] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.987586] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.987802] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.987896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.988058] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 is going to be updated. [ 837.022373] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.022617] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.022681] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.023038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.023205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.034230] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: IN_PROGRESS for 2s [ 837.062534] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-203 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.062841] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-203" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.063049] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-203" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.063364] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-203" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.063696] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.063927] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.064355] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.064702] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.065271] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.065271] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 837.065629] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 837.065903] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 837.066103] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 837.066685] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 837.066932] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 837.067151] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 837.086780] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 837.086959] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 837.087980] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 837.087980] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-203" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.087980] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-d0780c40-8a68-4d93-938c-96312b4436ec taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.087980] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-d0780c40-8a68-4d93-938c-96312b4436ec" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.087980] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-d0780c40-8a68-4d93-938c-96312b4436ec" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.088350] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-d0780c40-8a68-4d93-938c-96312b4436ec" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.088575] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0780c40-8a68-4d93-938c-96312b4436ec',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.592055] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.592273] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.592345] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.593966] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.593966] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.593966] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port d0780c40-8a68-4d93-938c-96312b4436ec not found, creating... [ 837.593966] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.593966] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.593966] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.593966] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.594495] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.594495] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.594495] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.594686] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.594999] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.594999] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.595212] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: d0780c40-8a68-4d93-938c-96312b4436ec is going to be created. [ 837.616893] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.617154] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.617270] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.617549] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.617778] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.618012] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-d0780c40-8a68-4d93-938c-96312b4436ec" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.204914] env[69920]: INFO networking_nsxv3.common.synchronization [req-ca6d3e5e-4f77-4207-ad48-258f643f5e58 req-dbba14b6-592e-4e03-9cc7-7d25f3354fd3 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 838.205231] env[69920]: INFO networking_nsxv3.common.synchronization [req-ca6d3e5e-4f77-4207-ad48-258f643f5e58 req-dbba14b6-592e-4e03-9cc7-7d25f3354fd3 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 with Priority: HIGHEST for action security_group_members [ 838.205802] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 838.206019] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 with Priority: HIGHEST for action security_group_members [ 838.206434] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.206616] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.206719] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.207152] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.207329] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.207451] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.207514] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.207753] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.207876] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.208115] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.209381] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cbc5f86-4dd3-4809-8201-0103be329ab2 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.209543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.209636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.209927] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.210153] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.210292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.210380] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.210584] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.210709] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.210851] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cbc5f86-4dd3-4809-8201-0103be329ab2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.371327] env[69920]: INFO networking_nsxv3.common.synchronization [req-ca6d3e5e-4f77-4207-ad48-258f643f5e58 req-dbba14b6-592e-4e03-9cc7-7d25f3354fd3 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 with Priority: HIGHEST for action security_group_rules [ 838.371507] env[69920]: INFO networking_nsxv3.common.synchronization [req-ca6d3e5e-4f77-4207-ad48-258f643f5e58 req-dbba14b6-592e-4e03-9cc7-7d25f3354fd3 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 with Priority: HIGHEST for action security_group_members [ 838.371643] env[69920]: INFO networking_nsxv3.common.synchronization [req-ca6d3e5e-4f77-4207-ad48-258f643f5e58 req-dbba14b6-592e-4e03-9cc7-7d25f3354fd3 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_rules [ 838.371771] env[69920]: INFO networking_nsxv3.common.synchronization [req-ca6d3e5e-4f77-4207-ad48-258f643f5e58 req-dbba14b6-592e-4e03-9cc7-7d25f3354fd3 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 838.371955] env[69920]: INFO networking_nsxv3.common.synchronization [req-ca6d3e5e-4f77-4207-ad48-258f643f5e58 req-dbba14b6-592e-4e03-9cc7-7d25f3354fd3 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: efc77bd5-a980-4a4e-9211-70184239a8ee with Priority: HIGHEST for action port [ 838.372491] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 with Priority: HIGHEST for action security_group_rules [ 838.372703] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_rules [ 838.372808] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efc77bd5-a980-4a4e-9211-70184239a8ee with Priority: HIGHEST for action port [ 838.372808] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 with Priority: HIGHEST for action security_group_members [ 838.372919] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 838.373205] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cbc5f86-4dd3-4809-8201-0103be329ab2 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.373330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.373397] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.373650] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.373731] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cbc5f86-4dd3-4809-8201-0103be329ab2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.374563] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.378156] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.378156] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.378156] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.378156] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.378156] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-efc77bd5-a980-4a4e-9211-70184239a8ee taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.378156] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efc77bd5-a980-4a4e-9211-70184239a8ee" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.378156] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efc77bd5-a980-4a4e-9211-70184239a8ee" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.378156] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efc77bd5-a980-4a4e-9211-70184239a8ee" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.378156] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efc77bd5-a980-4a4e-9211-70184239a8ee',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.378156] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cbc5f86-4dd3-4809-8201-0103be329ab2 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.378156] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.378156] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.378156] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.666026] env[69920]: INFO networking_nsxv3.common.synchronization [req-4b821e53-a0eb-445b-83ae-11a479d177ac req-c8e47d1a-ad8a-4644-81a9-973c2a1cb49e service nova] Enqueued Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_rules [ 838.666159] env[69920]: INFO networking_nsxv3.common.synchronization [req-4b821e53-a0eb-445b-83ae-11a479d177ac req-c8e47d1a-ad8a-4644-81a9-973c2a1cb49e service nova] Enqueued Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 838.666301] env[69920]: INFO networking_nsxv3.common.synchronization [req-4b821e53-a0eb-445b-83ae-11a479d177ac req-c8e47d1a-ad8a-4644-81a9-973c2a1cb49e service nova] Enqueued Resource ID: d0780c40-8a68-4d93-938c-96312b4436ec with Priority: HIGHEST for action port [ 838.666527] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_rules [ 838.666668] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 838.666763] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0780c40-8a68-4d93-938c-96312b4436ec with Priority: HIGHEST for action port [ 838.668029] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.668166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.668248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.668469] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.668557] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.669497] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.671950] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.671950] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0780c40-8a68-4d93-938c-96312b4436ec taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.671950] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0780c40-8a68-4d93-938c-96312b4436ec" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.671950] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0780c40-8a68-4d93-938c-96312b4436ec" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.671950] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0780c40-8a68-4d93-938c-96312b4436ec" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.671950] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0780c40-8a68-4d93-938c-96312b4436ec',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.713948] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.714547] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6cbc5f86-4dd3-4809-8201-0103be329ab2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.734732] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 in Status: SUCCESS [ 838.734732] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.734732] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.734732] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.734732] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.734732] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.734732] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.734732] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.734732] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.734732] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.734732] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('394b8a58-53d4-4ddb-998c-b2810a22cd53',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.875386] env[69920]: INFO networking_nsxv3.common.synchronization [req-8f50dc13-917b-4b8b-81ef-6615620e1989 req-4be31e67-87ea-43af-9097-85534a36b8fa tempest-ServersNegativeTestMultiTenantJSON-908142255 tempest-ServersNegativeTestMultiTenantJSON-908142255-project-member] Enqueued Resource ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c with Priority: HIGHEST for action security_group_members [ 838.875998] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c with Priority: HIGHEST for action security_group_members [ 838.876347] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.877784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.877784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.877784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.877784] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.877784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.877784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.878182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.878182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.878272] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c19f5e9b-e818-4af4-9417-0ddc1f2e116c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.879269] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cbc5f86-4dd3-4809-8201-0103be329ab2 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.879513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.880343] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.880458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.880699] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port efc77bd5-a980-4a4e-9211-70184239a8ee with status ACTIVE [ 838.880886] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.881011] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.881884] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.881884] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.881884] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.881884] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.881884] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.881884] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.881884] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.882222] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.882222] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.882318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.882318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.882502] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.882558] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.882725] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: efc77bd5-a980-4a4e-9211-70184239a8ee is going to be updated. [ 838.912712] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.913182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.913182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.913182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.913406] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.913456] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efc77bd5-a980-4a4e-9211-70184239a8ee" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.065384] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: SUCCESS [ 839.065384] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 deletion is rescheduled due to dependency. [ 839.065384] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.065384] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.065384] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.065384] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.065384] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.065384] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.066438] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.066438] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.066438] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.172930] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.173076] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.173282] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d0780c40-8a68-4d93-938c-96312b4436ec with status ACTIVE [ 839.173449] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.173551] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.173611] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.173832] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.173917] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.174102] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.174190] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.174247] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.174394] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.174468] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.174637] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.174720] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.174776] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.175012] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.175088] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.175169] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d0780c40-8a68-4d93-938c-96312b4436ec is going to be updated. [ 839.203616] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.203774] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.203844] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.204126] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.205035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.205035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0780c40-8a68-4d93-938c-96312b4436ec" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.218924] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.218924] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6cbc5f86-4dd3-4809-8201-0103be329ab2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.241764] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('394b8a58-53d4-4ddb-998c-b2810a22cd53',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.382314] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.382314] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.382314] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.382314] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.382314] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.382314] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.382314] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.382314] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.382314] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.382314] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.382314] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c already deleted. [ 839.382314] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.454962] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-895 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.454962] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-895" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.454962] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-895" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.455485] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-895" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.456013] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.458368] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.458368] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.460590] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.460590] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.460590] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 839.460590] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 839.460590] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 839.460590] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 839.460590] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 839.460845] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 839.460845] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 839.465999] env[69920]: INFO networking_nsxv3.common.synchronization [req-b2d44c12-7009-48c8-ba77-56b27ea05ad8 req-dbaf6f90-34e4-4c98-99fc-a6c4b45b79d2 tempest-FloatingIPsAssociationTestJSON-1358918757 tempest-FloatingIPsAssociationTestJSON-1358918757-project-member] Enqueued Resource ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd with Priority: HIGHEST for action security_group_members [ 839.466111] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd with Priority: HIGHEST for action security_group_members [ 839.466856] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-40f3bd9f-8637-49e8-92cd-03812c846cfd taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.466856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.466856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.466856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.467150] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.467150] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.467150] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.467327] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.467327] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.467415] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.482985] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 839.483211] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 839.483344] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 839.483471] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-895" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.483816] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-3da71ace-83d3-4b37-b02c-724f53d7f8bf taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.483993] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-3da71ace-83d3-4b37-b02c-724f53d7f8bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.484132] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-3da71ace-83d3-4b37-b02c-724f53d7f8bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.484468] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-3da71ace-83d3-4b37-b02c-724f53d7f8bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.484707] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3da71ace-83d3-4b37-b02c-724f53d7f8bf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.570835] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.719682] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.719928] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.720020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.720393] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.720522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.720659] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 is going to be updated. [ 839.722957] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.723949] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.723949] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.724658] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.724658] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.724658] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 is going to be created. [ 839.746634] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 394b8a58-53d4-4ddb-998c-b2810a22cd53: rpc.has_security_group_logging(os_id): False [ 839.769438] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.769438] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.769438] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.769778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.769853] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.774620] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.774785] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.774948] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.775205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.775446] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.777370] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.777496] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.777555] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.777749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.777838] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.778081] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.778183] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.778246] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.778399] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.778481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.778569] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 is going to be created. [ 839.785777] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: IN_PROGRESS for 2s [ 839.794485] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 in Status: UNINITIALIZED for 2s [ 839.831062] env[69920]: INFO networking_nsxv3.common.synchronization [req-4e85b894-1a37-41c9-96bd-5a1955e48ba9 req-7977f494-055d-4722-97ac-d24f951a70d7 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 with Priority: HIGHEST for action security_group_members [ 839.835135] env[69920]: INFO networking_nsxv3.common.synchronization [req-4e85b894-1a37-41c9-96bd-5a1955e48ba9 req-7977f494-055d-4722-97ac-d24f951a70d7 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 839.835425] env[69920]: INFO networking_nsxv3.common.synchronization [req-4e85b894-1a37-41c9-96bd-5a1955e48ba9 req-7977f494-055d-4722-97ac-d24f951a70d7 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 with Priority: HIGHEST for action security_group_members [ 839.836127] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 with Priority: HIGHEST for action security_group_members [ 839.836391] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 839.836497] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 with Priority: HIGHEST for action security_group_members [ 839.836784] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9141c37-2b91-4c20-add2-e8a0090bfc23 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.836907] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.836977] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.837295] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.837460] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.837567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.837628] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.837787] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.837888] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.838027] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9141c37-2b91-4c20-add2-e8a0090bfc23',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.839560] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.839646] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.839850] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cbc5f86-4dd3-4809-8201-0103be329ab2 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.839939] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.896107] env[69920]: INFO networking_nsxv3.common.synchronization [req-4e85b894-1a37-41c9-96bd-5a1955e48ba9 req-7977f494-055d-4722-97ac-d24f951a70d7 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 with Priority: HIGHEST for action security_group_rules [ 839.896298] env[69920]: INFO networking_nsxv3.common.synchronization [req-4e85b894-1a37-41c9-96bd-5a1955e48ba9 req-7977f494-055d-4722-97ac-d24f951a70d7 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 with Priority: HIGHEST for action security_group_members [ 839.896433] env[69920]: INFO networking_nsxv3.common.synchronization [req-4e85b894-1a37-41c9-96bd-5a1955e48ba9 req-7977f494-055d-4722-97ac-d24f951a70d7 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 with Priority: HIGHEST for action security_group_rules [ 839.896717] env[69920]: INFO networking_nsxv3.common.synchronization [req-4e85b894-1a37-41c9-96bd-5a1955e48ba9 req-7977f494-055d-4722-97ac-d24f951a70d7 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 with Priority: HIGHEST for action security_group_members [ 839.896947] env[69920]: INFO networking_nsxv3.common.synchronization [req-4e85b894-1a37-41c9-96bd-5a1955e48ba9 req-7977f494-055d-4722-97ac-d24f951a70d7 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_rules [ 839.897064] env[69920]: INFO networking_nsxv3.common.synchronization [req-4e85b894-1a37-41c9-96bd-5a1955e48ba9 req-7977f494-055d-4722-97ac-d24f951a70d7 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 839.897197] env[69920]: INFO networking_nsxv3.common.synchronization [req-4e85b894-1a37-41c9-96bd-5a1955e48ba9 req-7977f494-055d-4722-97ac-d24f951a70d7 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: efc77bd5-a980-4a4e-9211-70184239a8ee with Priority: HIGHEST for action port [ 839.897751] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 with Priority: HIGHEST for action security_group_rules [ 839.897898] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 with Priority: HIGHEST for action security_group_rules [ 839.897993] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 839.898104] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efc77bd5-a980-4a4e-9211-70184239a8ee with Priority: HIGHEST for action port [ 839.898193] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_rules [ 839.898279] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 with Priority: HIGHEST for action security_group_members [ 839.898361] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 with Priority: HIGHEST for action security_group_members [ 839.898635] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cbc5f86-4dd3-4809-8201-0103be329ab2 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.898783] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.898905] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9141c37-2b91-4c20-add2-e8a0090bfc23 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.899013] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.899078] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.899374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.899411] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9141c37-2b91-4c20-add2-e8a0090bfc23',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.900274] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.900356] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.904316] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-efc77bd5-a980-4a4e-9211-70184239a8ee taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.904316] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efc77bd5-a980-4a4e-9211-70184239a8ee" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.904316] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efc77bd5-a980-4a4e-9211-70184239a8ee" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.904316] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efc77bd5-a980-4a4e-9211-70184239a8ee" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.904316] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efc77bd5-a980-4a4e-9211-70184239a8ee',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.904316] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.904525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.904629] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cbc5f86-4dd3-4809-8201-0103be329ab2 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.904679] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.906488] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9141c37-2b91-4c20-add2-e8a0090bfc23 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.906488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.917064] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.917064] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.917064] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.917293] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.917377] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.933186] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 in Status: IN_PROGRESS for 2s [ 839.970248] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.987357] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.987580] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.987708] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.988109] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.988412] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.988485] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 3da71ace-83d3-4b37-b02c-724f53d7f8bf not found, creating... [ 839.989835] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.989835] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.989835] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.989835] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.989835] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.989835] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.989835] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.990480] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.991022] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.991147] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.991302] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 3da71ace-83d3-4b37-b02c-724f53d7f8bf is going to be created. [ 840.038020] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.038020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.038020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.038020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.038020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.038020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-3da71ace-83d3-4b37-b02c-724f53d7f8bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.074705] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.340763] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9141c37-2b91-4c20-add2-e8a0090bfc23',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.406369] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9141c37-2b91-4c20-add2-e8a0090bfc23 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.406500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.406695] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port efc77bd5-a980-4a4e-9211-70184239a8ee with status ACTIVE [ 840.406864] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.406973] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.407052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.407284] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.407379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.407547] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.407705] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.407705] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.407863] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.407942] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.408133] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.408233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.408293] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.408432] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.408506] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.408590] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: efc77bd5-a980-4a4e-9211-70184239a8ee is going to be updated. [ 840.440971] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.441160] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.441244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.441467] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.441612] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.441774] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efc77bd5-a980-4a4e-9211-70184239a8ee" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.473322] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.579597] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.580209] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.580959] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.581256] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.581554] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.581675] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 is going to be updated. [ 840.629856] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.629930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.630031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.630275] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.630465] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.642793] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: IN_PROGRESS for 2s [ 840.819467] env[69920]: INFO networking_nsxv3.common.synchronization [req-8f50dc13-917b-4b8b-81ef-6615620e1989 req-904655a4-7a22-4caa-9348-c48afeac854d service nova] Enqueued Resource ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c with Priority: HIGHEST for action security_group_rules [ 840.820399] env[69920]: INFO networking_nsxv3.common.synchronization [req-8f50dc13-917b-4b8b-81ef-6615620e1989 req-904655a4-7a22-4caa-9348-c48afeac854d service nova] Enqueued Resource ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c with Priority: HIGHEST for action security_group_members [ 840.822375] env[69920]: INFO networking_nsxv3.common.synchronization [req-8f50dc13-917b-4b8b-81ef-6615620e1989 req-904655a4-7a22-4caa-9348-c48afeac854d service nova] Enqueued Resource ID: 3da71ace-83d3-4b37-b02c-724f53d7f8bf with Priority: HIGHEST for action port [ 840.823128] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c with Priority: HIGHEST for action security_group_rules [ 840.823283] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c with Priority: HIGHEST for action security_group_members [ 840.823380] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3da71ace-83d3-4b37-b02c-724f53d7f8bf with Priority: HIGHEST for action port [ 840.824166] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c19f5e9b-e818-4af4-9417-0ddc1f2e116c taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.824270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.824308] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.824668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.824867] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c19f5e9b-e818-4af4-9417-0ddc1f2e116c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.826239] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.826549] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.826549] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.826712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.826861] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.826956] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.827033] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.827185] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.827267] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.827358] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c19f5e9b-e818-4af4-9417-0ddc1f2e116c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.828595] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-3da71ace-83d3-4b37-b02c-724f53d7f8bf taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.828726] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3da71ace-83d3-4b37-b02c-724f53d7f8bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.829046] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3da71ace-83d3-4b37-b02c-724f53d7f8bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.829046] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3da71ace-83d3-4b37-b02c-724f53d7f8bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.829046] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3da71ace-83d3-4b37-b02c-724f53d7f8bf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.844887] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9141c37-2b91-4c20-add2-e8a0090bfc23',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.976950] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.977820] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.977820] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.977820] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.977820] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.977820] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd is going to be updated. [ 841.010612] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.010859] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.010975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.011271] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.011464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.028070] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd in Status: IN_PROGRESS for 2s [ 841.176199] env[69920]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] NSXv3 Agent Agent loop - iteration:0 completed [ 841.176358] env[69920]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] NSXv3 Agent Agent loop - iteration:1 started [ 841.328249] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.328444] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.328647] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c19f5e9b-e818-4af4-9417-0ddc1f2e116c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.332159] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3da71ace-83d3-4b37-b02c-724f53d7f8bf with status ACTIVE [ 841.332159] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.332495] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.332495] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.334903] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.334903] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.334903] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.334903] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.334903] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.334903] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.334903] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.334903] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.334903] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.334903] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.334903] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.334903] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.334903] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3da71ace-83d3-4b37-b02c-724f53d7f8bf is going to be updated. [ 841.349794] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.349794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.349794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.349794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.349794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.349794] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 is going to be created. [ 841.359919] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.360096] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.360168] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.360377] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.360531] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.360673] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3da71ace-83d3-4b37-b02c-724f53d7f8bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.377560] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.380397] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.380397] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.380397] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.380397] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.397138] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 in Status: UNINITIALIZED for 2s [ 841.795677] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: SUCCESS [ 841.795956] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.797070] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.797421] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.797611] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.797728] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.797797] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.797971] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.798522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.798901] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.809429] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 in Status: SUCCESS [ 841.809914] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.809914] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.810129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.810214] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.810330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.810393] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.810546] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.811072] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.811072] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cbc5f86-4dd3-4809-8201-0103be329ab2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.832591] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c19f5e9b-e818-4af4-9417-0ddc1f2e116c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.947624] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 in Status: SUCCESS [ 841.947850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.301495] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.315788] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6cbc5f86-4dd3-4809-8201-0103be329ab2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.335217] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.335217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.335217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.335217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.335441] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.335441] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c is going to be created. [ 842.366391] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.370203] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.370203] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.370203] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.370203] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.379880] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c in Status: UNINITIALIZED for 2s [ 842.654567] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: SUCCESS [ 842.654785] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.655075] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.655328] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.655536] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.655657] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.655724] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.662375] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.662487] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.662590] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.662692] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.805703] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.819230] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6cbc5f86-4dd3-4809-8201-0103be329ab2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.041990] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd in Status: SUCCESS [ 843.042849] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.169873] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.170074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.170161] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.170784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.171014] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.171176] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.171245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.171464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.171571] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.171670] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.171842] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.175026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.175026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.175026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.175026] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.175026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.175026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.175026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.175026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.175026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.175026] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.309661] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.309879] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.309879] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.310101] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.310350] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.310477] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 is going to be updated. [ 843.321760] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.321760] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.321760] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.321760] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.321760] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.321760] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 is going to be updated. [ 843.348310] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.348591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.348591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.348793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.348993] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.362614] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: IN_PROGRESS for 2s [ 843.367330] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.367330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.367330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.367601] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.367635] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.380946] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 in Status: IN_PROGRESS for 2s [ 843.426402] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 in Status: SUCCESS [ 843.426402] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.426402] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.426402] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.428360] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.428615] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.428680] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.429987] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.429987] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.429987] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9141c37-2b91-4c20-add2-e8a0090bfc23',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.675548] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1712776d-764c-405e-85d0-105070b4c2e8: rpc.has_security_group_logging(os_id): False [ 843.698607] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.698786] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.698842] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.699060] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.699155] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.699365] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.699465] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.699531] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.699684] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.699762] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.699939] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.700054] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.700127] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.700237] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.700310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.700496] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.702193] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.702270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.702447] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.702533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.702626] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 is going to be updated. [ 843.778257] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.778459] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.778459] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.779867] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.779867] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.801835] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: IN_PROGRESS for 2s [ 843.932028] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9141c37-2b91-4c20-add2-e8a0090bfc23',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.392335] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c in Status: SUCCESS [ 844.392634] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.392824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.393086] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.393979] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.394106] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.394253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.394483] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.394620] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.394756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.395239] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c19f5e9b-e818-4af4-9417-0ddc1f2e116c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.435875] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9141c37-2b91-4c20-add2-e8a0090bfc23',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.897822] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.898146] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.898146] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.898659] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.898659] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.898769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.898807] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.898975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.899084] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.899195] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.899525] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.899676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.899950] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.900059] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.900285] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.900382] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.900471] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.900615] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.900797] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.901042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.901209] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c19f5e9b-e818-4af4-9417-0ddc1f2e116c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.937781] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.938012] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.938147] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.938426] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.938870] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.938870] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 is going to be updated. [ 844.995316] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.995495] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.995557] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.995740] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.995908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.008115] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 in Status: IN_PROGRESS for 2s [ 845.376408] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: SUCCESS [ 845.376695] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.376860] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.377033] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.377234] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.377343] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.377422] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.377572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.377656] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.377742] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.377842] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.378761] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.379271] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.379271] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.379271] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.379466] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.379466] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.379542] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.379605] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.396018] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 in Status: SUCCESS [ 845.396458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.396700] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.396931] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.397144] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.397264] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.397322] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.397484] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.397565] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.397653] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.397754] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6cbc5f86-4dd3-4809-8201-0103be329ab2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.399302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.399302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.399302] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.399302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.400266] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.400266] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.400266] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.400266] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cbc5f86-4dd3-4809-8201-0103be329ab2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.403516] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c19f5e9b-e818-4af4-9417-0ddc1f2e116c: rpc.has_security_group_logging(os_id): False [ 845.426270] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.426522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.426653] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.426988] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.427157] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.427490] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.427658] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.427770] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.428050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.428357] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.428664] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.428837] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.428958] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.429227] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.429402] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.429670] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.429821] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.429921] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.430197] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.430321] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.430452] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c is going to be created. [ 845.514129] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.514356] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.514356] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.514558] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.514744] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.530145] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c in Status: IN_PROGRESS for 2s [ 845.820792] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: SUCCESS [ 845.820792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.824082] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 845.824257] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=11 [ 845.882568] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.884149] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.884149] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.901567] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6cbc5f86-4dd3-4809-8201-0103be329ab2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.902544] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6cbc5f86-4dd3-4809-8201-0103be329ab2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.263536] env[69920]: INFO networking_nsxv3.common.synchronization [req-47ebfba2-25f9-485d-bd78-4bca2d523364 req-449776d0-9339-4a5d-a6f4-c1791d7d28b6 tempest-TenantUsagesTestJSON-1584323566 tempest-TenantUsagesTestJSON-1584323566-project-member] Enqueued Resource ID: fb749722-17ca-41f8-9be5-6aa59fad95b3 with Priority: HIGHEST for action security_group_members [ 846.264935] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb749722-17ca-41f8-9be5-6aa59fad95b3 with Priority: HIGHEST for action security_group_members [ 846.265294] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb749722-17ca-41f8-9be5-6aa59fad95b3 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.265463] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.265532] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.266384] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.267914] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.268069] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.268145] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.268383] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.268501] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.268623] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb749722-17ca-41f8-9be5-6aa59fad95b3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.386222] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.406772] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6cbc5f86-4dd3-4809-8201-0103be329ab2: rpc.has_security_group_logging(os_id): False [ 846.408131] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6cbc5f86-4dd3-4809-8201-0103be329ab2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.436339] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.436512] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.436622] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.437008] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.437223] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.437541] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.437705] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.437815] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.438231] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.438370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.438583] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 is going to be created. [ 846.531189] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.531354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.531400] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.531775] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.531775] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.550358] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 in Status: IN_PROGRESS for 2s [ 846.670255] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-207 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.670457] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.670588] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.670859] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.671133] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.671294] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.671416] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.671767] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.672024] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.672543] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 846.672543] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 846.672704] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 846.672854] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 846.673034] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 846.673214] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 846.673434] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 846.696682] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 846.696893] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 846.697052] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 846.697248] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.697588] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-d61e5620-93c1-42e0-b372-c977dbc31d1c taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.697769] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-d61e5620-93c1-42e0-b372-c977dbc31d1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.697894] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-d61e5620-93c1-42e0-b372-c977dbc31d1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.698492] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-d61e5620-93c1-42e0-b372-c977dbc31d1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.698648] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d61e5620-93c1-42e0-b372-c977dbc31d1c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.774353] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.774574] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.774646] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.774884] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.775057] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.775346] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.775346] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.775511] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.775578] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.775649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.775753] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb749722-17ca-41f8-9be5-6aa59fad95b3 already deleted. [ 846.775855] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.889756] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.889756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.889756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.889756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.889756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.889756] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 is going to be updated. [ 846.911281] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.913988] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.913988] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.913988] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.913988] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.913988] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 is going to be updated. [ 846.969905] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.969905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.969905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.969905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.969905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.970899] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.971090] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.971241] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.971470] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.971640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.988621] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: IN_PROGRESS for 2s [ 846.988621] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 in Status: IN_PROGRESS for 2s [ 847.021859] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 in Status: SUCCESS [ 847.022117] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.022273] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.022488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.022679] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.022827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.024339] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.024339] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.024339] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.024339] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.024339] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9141c37-2b91-4c20-add2-e8a0090bfc23',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.126439] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.126610] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.126682] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.126904] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.127049] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.206021] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.206021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.206021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.206021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.206021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.206021] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port d61e5620-93c1-42e0-b372-c977dbc31d1c not found, creating... [ 847.206021] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.206021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.206021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.206021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.206021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.206575] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.206575] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.206575] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.206575] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.206575] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.207019] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: d61e5620-93c1-42e0-b372-c977dbc31d1c is going to be created. [ 847.240407] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.240407] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.240407] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.240407] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.240407] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.240407] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-d61e5620-93c1-42e0-b372-c977dbc31d1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.525453] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9141c37-2b91-4c20-add2-e8a0090bfc23',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.551106] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c in Status: SUCCESS [ 847.551528] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.629956] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.027670] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9141c37-2b91-4c20-add2-e8a0090bfc23: rpc.has_security_group_logging(os_id): False [ 848.054253] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.054253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.054253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.054253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.054253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.054253] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.054253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.054253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.054253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.054253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.054253] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 is going to be created. [ 848.125050] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.125050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.125050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.125050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.125050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.137343] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.141030] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 in Status: IN_PROGRESS for 2s [ 848.182333] env[69920]: INFO networking_nsxv3.common.synchronization [req-47ebfba2-25f9-485d-bd78-4bca2d523364 req-bc4d970c-4792-4dd9-b400-cf075829b39f service nova] Enqueued Resource ID: fb749722-17ca-41f8-9be5-6aa59fad95b3 with Priority: HIGHEST for action security_group_rules [ 848.182742] env[69920]: INFO networking_nsxv3.common.synchronization [req-47ebfba2-25f9-485d-bd78-4bca2d523364 req-bc4d970c-4792-4dd9-b400-cf075829b39f service nova] Enqueued Resource ID: fb749722-17ca-41f8-9be5-6aa59fad95b3 with Priority: HIGHEST for action security_group_members [ 848.182742] env[69920]: INFO networking_nsxv3.common.synchronization [req-47ebfba2-25f9-485d-bd78-4bca2d523364 req-bc4d970c-4792-4dd9-b400-cf075829b39f service nova] Enqueued Resource ID: d61e5620-93c1-42e0-b372-c977dbc31d1c with Priority: HIGHEST for action port [ 848.186322] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb749722-17ca-41f8-9be5-6aa59fad95b3 with Priority: HIGHEST for action security_group_rules [ 848.186322] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb749722-17ca-41f8-9be5-6aa59fad95b3 with Priority: HIGHEST for action security_group_members [ 848.186322] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d61e5620-93c1-42e0-b372-c977dbc31d1c with Priority: HIGHEST for action port [ 848.186322] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb749722-17ca-41f8-9be5-6aa59fad95b3 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.186322] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.186322] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.186322] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.186322] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb749722-17ca-41f8-9be5-6aa59fad95b3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.186628] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb749722-17ca-41f8-9be5-6aa59fad95b3 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.186628] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.186725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.189359] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.189359] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.189359] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.189359] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.189359] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.189359] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.189359] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb749722-17ca-41f8-9be5-6aa59fad95b3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.189834] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-d61e5620-93c1-42e0-b372-c977dbc31d1c taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.189951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d61e5620-93c1-42e0-b372-c977dbc31d1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.189988] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d61e5620-93c1-42e0-b372-c977dbc31d1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.192039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d61e5620-93c1-42e0-b372-c977dbc31d1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.192039] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d61e5620-93c1-42e0-b372-c977dbc31d1c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.565708] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 in Status: SUCCESS [ 848.566615] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.566615] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.566615] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.566615] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cbc5f86-4dd3-4809-8201-0103be329ab2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.643912] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 848.643912] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 848.692687] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb749722-17ca-41f8-9be5-6aa59fad95b3 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.692839] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.693081] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb749722-17ca-41f8-9be5-6aa59fad95b3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.694351] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d61e5620-93c1-42e0-b372-c977dbc31d1c with status ACTIVE [ 848.694510] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.694680] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.694680] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.694917] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.695067] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.695244] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.695362] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.695399] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.695571] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.695637] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.696228] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.696228] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.696228] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.696365] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.696365] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.696560] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d61e5620-93c1-42e0-b372-c977dbc31d1c is going to be updated. [ 848.719673] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.719905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.719964] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.720207] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.720352] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.720513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d61e5620-93c1-42e0-b372-c977dbc31d1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.995926] env[69920]: INFO networking_nsxv3.common.synchronization [req-f9d42ef4-a631-4537-84e8-fa7838b78460 req-4782bd97-623d-4f8e-9daa-3f9f9872f868 tempest-ServerRescueTestJSON-1075581336 tempest-ServerRescueTestJSON-1075581336-project-member] Enqueued Resource ID: a6054485-180a-4f29-a65a-3151187db51e with Priority: HIGHEST for action security_group_members [ 848.996508] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6054485-180a-4f29-a65a-3151187db51e with Priority: HIGHEST for action security_group_members [ 848.997324] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6054485-180a-4f29-a65a-3151187db51e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.997324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.997324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.997324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.997550] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.997550] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.997634] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.997743] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.997827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.997976] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6054485-180a-4f29-a65a-3151187db51e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.002020] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 in Status: SUCCESS [ 849.002020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.002020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.002020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.002020] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.002020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.002020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.002020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.002020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.002020] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cbc5f86-4dd3-4809-8201-0103be329ab2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.003278] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: SUCCESS [ 849.003450] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.003848] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.004025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.004182] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.004282] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.004343] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.004481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.004556] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.004800] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.069343] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cbc5f86-4dd3-4809-8201-0103be329ab2 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.069343] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.194697] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb749722-17ca-41f8-9be5-6aa59fad95b3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.499791] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6054485-180a-4f29-a65a-3151187db51e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.506603] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6cbc5f86-4dd3-4809-8201-0103be329ab2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.508067] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.698206] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.698511] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.698511] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.699308] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.699456] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.699592] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb749722-17ca-41f8-9be5-6aa59fad95b3 is going to be created. [ 849.730290] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.730481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.730523] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.730715] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.730874] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.742480] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb749722-17ca-41f8-9be5-6aa59fad95b3 in Status: UNINITIALIZED for 2s [ 849.755801] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-757 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.756325] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-757" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.757051] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-757" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.757474] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-757" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.760489] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.760762] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.760922] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.761308] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.761507] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.761759] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 849.761906] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 849.762061] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 849.763221] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 849.763400] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 849.763554] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 849.763731] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 849.783141] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 849.783345] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 849.783512] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 849.783696] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-757" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.784025] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-ff1455ee-4ab2-4e4d-ac72-6a6554002936 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.784206] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-ff1455ee-4ab2-4e4d-ac72-6a6554002936" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.784329] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-ff1455ee-4ab2-4e4d-ac72-6a6554002936" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.784656] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-ff1455ee-4ab2-4e4d-ac72-6a6554002936" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.784799] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff1455ee-4ab2-4e4d-ac72-6a6554002936',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.818408] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.818592] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.818645] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.818902] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.843239] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 849.844244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.846350] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 849.903976] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.903976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.904331] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.904331] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.909925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.910400] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 849.910482] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 849.910569] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 849.952238] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.952394] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.953197] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.953352] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.954633] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.954824] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 850.002194] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6054485-180a-4f29-a65a-3151187db51e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.009911] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6cbc5f86-4dd3-4809-8201-0103be329ab2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.013038] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.075976] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.076105] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.076180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.076395] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.076613] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.076839] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 850.158838] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 in Status: SUCCESS [ 850.159097] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.163572] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.163719] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.163760] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.164019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.164225] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.164460] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:32. [ 850.164542] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'b6124cb4-db5b-4093-b85f-7d68bc614215', '4b4fb140-8d8f-45fe-9d42-7405286ea87b', '5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc', 'c19f5e9b-e818-4af4-9417-0ddc1f2e116c', '667ad5b8-40a7-4438-a71d-51999e9b972e', '0e86ba42-7c29-4732-915b-33713b63d0b7', '7fdaff9b-63be-497c-8622-3160e739856a', '6cbc5f86-4dd3-4809-8201-0103be329ab2', '3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f', '82051f94-9eeb-470d-aa42-9e827049069f', '06e5cbff-80b3-432a-81ac-0bf4249c4679', '8772ae4d-b3d8-4986-b291-e37049ac05b0', '0da8b432-7927-4b3d-81a7-f990d2563525', '7eba410e-a0d6-4873-9363-054f457d21d4', 'c27221ee-5342-4aa7-83da-a28291a2021a', '40f3bd9f-8637-49e8-92cd-03812c846cfd', 'a9141c37-2b91-4c20-add2-e8a0090bfc23', 'fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5', '48d70a54-3f5c-40ef-9cc4-f5d82c01a717', 'f8b9ce1a-2b8e-4a65-b28c-620181c45204', '8f8bd1f0-245d-4d6b-8841-4e7773984ffb', 'e31e2ae5-2f08-403b-b19a-697a36f3cb16', 'd76d1ef7-21d9-442e-8d89-3b9cfee5a4ac', '6440e2db-5336-4fd7-b450-468fa8f78560', 'b3cdaff7-e960-4617-83ae-85aa804dab73', '154896d4-d0bc-49e9-8d89-5fcc04260b1a', '5a8bd4df-a8df-4d64-94ea-a00a62c48a01', '1712776d-764c-405e-85d0-105070b4c2e8', 'a6054485-180a-4f29-a65a-3151187db51e', '394b8a58-53d4-4ddb-998c-b2810a22cd53', '361f5d4b-d775-40f2-9486-50f4511d4852', '156af133-c5cb-4af5-87be-b21d4422308a'} {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 850.164642] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 850.205052] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.205052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.205052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.205052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.205052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.205052] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 850.205052] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 850.205052] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 850.288175] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.288594] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.288594] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.289769] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.289769] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.289769] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port ff1455ee-4ab2-4e4d-ac72-6a6554002936 not found, creating... [ 850.289769] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.289769] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.289769] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.289769] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.290190] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.290255] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.291297] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.291297] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.291297] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.291297] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.291297] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: ff1455ee-4ab2-4e4d-ac72-6a6554002936 is going to be created. [ 850.329766] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.330129] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.330209] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.330512] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.330797] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.332105] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-ff1455ee-4ab2-4e4d-ac72-6a6554002936" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.358979] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.360187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.360187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.360187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.360353] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.360524] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 850.360595] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 850.360671] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 850.360738] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 850.360820] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/32 resources of Type:Security Group Rules [ 850.361051] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b6124cb4-db5b-4093-b85f-7d68bc614215 with Priority: HIGH for action security_group_rules [ 850.361051] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGH for action security_group_rules [ 850.361051] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc with Priority: HIGH for action security_group_rules [ 850.361190] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c with Priority: HIGH for action security_group_rules [ 850.361190] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 667ad5b8-40a7-4438-a71d-51999e9b972e with Priority: HIGH for action security_group_rules [ 850.361242] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 with Priority: HIGH for action security_group_rules [ 850.361285] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGH for action security_group_rules [ 850.361422] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 with Priority: HIGH for action security_group_rules [ 850.361997] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f with Priority: HIGH for action security_group_rules [ 850.361997] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 82051f94-9eeb-470d-aa42-9e827049069f with Priority: HIGH for action security_group_rules [ 850.361997] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 with Priority: HIGH for action security_group_rules [ 850.361997] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8772ae4d-b3d8-4986-b291-e37049ac05b0 with Priority: HIGH for action security_group_rules [ 850.361997] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0da8b432-7927-4b3d-81a7-f990d2563525 with Priority: HIGH for action security_group_rules [ 850.361997] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGH for action security_group_rules [ 850.361997] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c27221ee-5342-4aa7-83da-a28291a2021a with Priority: HIGH for action security_group_rules [ 850.361997] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd with Priority: HIGH for action security_group_rules [ 850.361997] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 with Priority: HIGH for action security_group_rules [ 850.361997] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 with Priority: HIGH for action security_group_rules [ 850.362396] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGH for action security_group_rules [ 850.362396] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f8b9ce1a-2b8e-4a65-b28c-620181c45204 with Priority: HIGH for action security_group_rules [ 850.362396] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.505453] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.505633] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.505690] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.505981] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.506222] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.506222] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6054485-180a-4f29-a65a-3151187db51e is going to be updated. [ 850.515486] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.515486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.515486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.515486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.515486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.515486] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 is going to be updated. [ 850.516112] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.516233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.516306] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.516487] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.516567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.516657] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 is going to be updated. [ 850.564454] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.564651] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.564717] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.565063] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.565253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.570150] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.570664] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.570664] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.570664] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.571127] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.575113] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.575113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.575113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.575113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.575113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.590454] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6054485-180a-4f29-a65a-3151187db51e in Status: IN_PROGRESS for 2s [ 850.591302] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: IN_PROGRESS for 2s [ 850.592491] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 in Status: IN_PROGRESS for 2s [ 851.021144] env[69920]: INFO networking_nsxv3.common.synchronization [None req-475455be-7837-4945-97eb-616c4387fa88 None None] Enqueued Resource ID: c1bdebba-2ee0-4e6b-8dbb-965ab154d32e with Priority: HIGHEST for action port [ 851.021144] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1bdebba-2ee0-4e6b-8dbb-965ab154d32e with Priority: HIGHEST for action port [ 851.021144] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6124cb4-db5b-4093-b85f-7d68bc614215 with Priority: HIGH for action security_group_rules [ 851.021144] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc with Priority: HIGH for action security_group_rules [ 851.021144] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGH for action security_group_rules [ 851.021144] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c27221ee-5342-4aa7-83da-a28291a2021a with Priority: HIGH for action security_group_rules [ 851.021144] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8b9ce1a-2b8e-4a65-b28c-620181c45204 with Priority: HIGH for action security_group_rules [ 851.021144] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGH for action security_group_rules [ 851.021144] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 with Priority: HIGH for action security_group_rules [ 851.021144] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 with Priority: HIGH for action security_group_rules [ 851.021144] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGH for action security_group_rules [ 851.022399] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd with Priority: HIGH for action security_group_rules [ 851.022722] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0da8b432-7927-4b3d-81a7-f990d2563525 with Priority: HIGH for action security_group_rules [ 851.025254] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8772ae4d-b3d8-4986-b291-e37049ac05b0 with Priority: HIGH for action security_group_rules [ 851.025254] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 with Priority: HIGH for action security_group_rules [ 851.025254] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82051f94-9eeb-470d-aa42-9e827049069f with Priority: HIGH for action security_group_rules [ 851.025254] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f with Priority: HIGH for action security_group_rules [ 851.025254] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 with Priority: HIGH for action security_group_rules [ 851.025254] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 with Priority: HIGH for action security_group_rules [ 851.025254] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 667ad5b8-40a7-4438-a71d-51999e9b972e with Priority: HIGH for action security_group_rules [ 851.025254] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b with Priority: HIGH for action security_group_rules [ 851.025254] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c with Priority: HIGH for action security_group_rules [ 851.025254] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1bdebba-2ee0-4e6b-8dbb-965ab154d32e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.026211] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1bdebba-2ee0-4e6b-8dbb-965ab154d32e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.026428] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1bdebba-2ee0-4e6b-8dbb-965ab154d32e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.027493] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1bdebba-2ee0-4e6b-8dbb-965ab154d32e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.027493] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1bdebba-2ee0-4e6b-8dbb-965ab154d32e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.030720] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6124cb4-db5b-4093-b85f-7d68bc614215 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.031085] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.032015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.032015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.032015] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6124cb4-db5b-4093-b85f-7d68bc614215',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.033101] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.033423] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.033643] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.033975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.034687] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.035867] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.036053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.036173] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.036423] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.036423] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.038737] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c27221ee-5342-4aa7-83da-a28291a2021a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.038737] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.038737] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.038737] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.038737] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c27221ee-5342-4aa7-83da-a28291a2021a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.040296] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8b9ce1a-2b8e-4a65-b28c-620181c45204 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.040863] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.040981] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.041202] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.041284] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8b9ce1a-2b8e-4a65-b28c-620181c45204',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.044032] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.044032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.044032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.044032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.044032] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.045051] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.045677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.045677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.045677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.046060] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.046995] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9141c37-2b91-4c20-add2-e8a0090bfc23 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.047360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.047360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.049149] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.049149] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9141c37-2b91-4c20-add2-e8a0090bfc23',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.049481] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.050241] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.050241] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.050590] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.050854] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.055286] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40f3bd9f-8637-49e8-92cd-03812c846cfd taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.055286] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.055286] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.055286] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.055286] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.055529] env[69920]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 851.058939] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0da8b432-7927-4b3d-81a7-f990d2563525 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.058939] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.058939] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.059376] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.059376] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0da8b432-7927-4b3d-81a7-f990d2563525',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.062742] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8772ae4d-b3d8-4986-b291-e37049ac05b0 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.062742] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.062742] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.062742] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.062742] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8772ae4d-b3d8-4986-b291-e37049ac05b0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.064488] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e5cbff-80b3-432a-81ac-0bf4249c4679 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.064598] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.064670] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.065553] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.065553] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e5cbff-80b3-432a-81ac-0bf4249c4679',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.065866] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82051f94-9eeb-470d-aa42-9e827049069f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.066355] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.066355] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.066355] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.066355] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82051f94-9eeb-470d-aa42-9e827049069f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.067243] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.068137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.068137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.068137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.068137] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.069248] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e86ba42-7c29-4732-915b-33713b63d0b7 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.069248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.069248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.069248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.069248] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e86ba42-7c29-4732-915b-33713b63d0b7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.069647] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cbc5f86-4dd3-4809-8201-0103be329ab2 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.069739] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.069938] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-667ad5b8-40a7-4438-a71d-51999e9b972e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.070038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.070108] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.070256] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.070325] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('667ad5b8-40a7-4438-a71d-51999e9b972e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.071293] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b4fb140-8d8f-45fe-9d42-7405286ea87b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.071402] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.071402] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.071563] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.071612] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b4fb140-8d8f-45fe-9d42-7405286ea87b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.072458] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c19f5e9b-e818-4af4-9417-0ddc1f2e116c taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.072542] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.072577] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.072760] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.072808] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c19f5e9b-e818-4af4-9417-0ddc1f2e116c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.077186] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6124cb4-db5b-4093-b85f-7d68bc614215 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.077338] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.077378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.077622] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.077701] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.077801] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.077863] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.078022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.078112] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.078197] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.078279] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6124cb4-db5b-4093-b85f-7d68bc614215',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.254605] env[69920]: INFO networking_nsxv3.common.synchronization [req-f9d42ef4-a631-4537-84e8-fa7838b78460 req-d64bad38-78f9-4c40-8316-91e6a1dd5a68 service nova] Enqueued Resource ID: a6054485-180a-4f29-a65a-3151187db51e with Priority: HIGHEST for action security_group_rules [ 851.254799] env[69920]: INFO networking_nsxv3.common.synchronization [req-f9d42ef4-a631-4537-84e8-fa7838b78460 req-d64bad38-78f9-4c40-8316-91e6a1dd5a68 service nova] Enqueued Resource ID: a6054485-180a-4f29-a65a-3151187db51e with Priority: HIGHEST for action security_group_members [ 851.254982] env[69920]: INFO networking_nsxv3.common.synchronization [req-f9d42ef4-a631-4537-84e8-fa7838b78460 req-d64bad38-78f9-4c40-8316-91e6a1dd5a68 service nova] Enqueued Resource ID: ff1455ee-4ab2-4e4d-ac72-6a6554002936 with Priority: HIGHEST for action port [ 851.255596] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6054485-180a-4f29-a65a-3151187db51e with Priority: HIGHEST for action security_group_rules [ 851.255788] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6054485-180a-4f29-a65a-3151187db51e with Priority: HIGHEST for action security_group_members [ 851.255975] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff1455ee-4ab2-4e4d-ac72-6a6554002936 with Priority: HIGHEST for action port [ 851.256315] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6054485-180a-4f29-a65a-3151187db51e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.256466] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.256525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.256715] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.256799] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6054485-180a-4f29-a65a-3151187db51e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.257210] env[69920]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 851.258034] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6054485-180a-4f29-a65a-3151187db51e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.258196] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.258525] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff1455ee-4ab2-4e4d-ac72-6a6554002936 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.258711] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff1455ee-4ab2-4e4d-ac72-6a6554002936" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.258819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff1455ee-4ab2-4e4d-ac72-6a6554002936" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.261991] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff1455ee-4ab2-4e4d-ac72-6a6554002936" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.262144] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff1455ee-4ab2-4e4d-ac72-6a6554002936',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.577213] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1bdebba-2ee0-4e6b-8dbb-965ab154d32e [ 851.579181] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.579181] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.579181] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.579662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.579662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.579662] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1bdebba-2ee0-4e6b-8dbb-965ab154d32e already deleted. [ 851.579662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1bdebba-2ee0-4e6b-8dbb-965ab154d32e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.581607] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6124cb4-db5b-4093-b85f-7d68bc614215',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.599150] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.599411] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.599411] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.599916] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.607268] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-40f3bd9f-8637-49e8-92cd-03812c846cfd taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.607268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.607268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.607268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.607268] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.607268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.607268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.607268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.607268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.607268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.607268] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.616976] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-82051f94-9eeb-470d-aa42-9e827049069f taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.617347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.617347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.617651] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.617651] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.617651] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.617928] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.617928] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.617928] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.618093] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.618093] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('82051f94-9eeb-470d-aa42-9e827049069f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.624996] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9141c37-2b91-4c20-add2-e8a0090bfc23 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.625240] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.625321] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.625555] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.625731] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.625837] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.625900] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.626260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.626376] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.626483] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.626587] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9141c37-2b91-4c20-add2-e8a0090bfc23',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.628944] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e86ba42-7c29-4732-915b-33713b63d0b7 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.628944] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.628944] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.628944] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.629235] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.629235] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.629370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.629415] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.629509] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.629615] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.629712] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e86ba42-7c29-4732-915b-33713b63d0b7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.632896] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.633065] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.633142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.633262] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.633449] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.633541] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.633648] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.633807] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.633918] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.634137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.634137] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.639700] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.639831] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc is going to be deleted. [ 851.643113] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('82051f94-9eeb-470d-aa42-9e827049069f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.644831] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.645011] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.645080] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.645284] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.650593] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.650776] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.650841] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.651014] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.651181] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.651277] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.651341] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.651497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.651586] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.651695] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.651804] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c19f5e9b-e818-4af4-9417-0ddc1f2e116c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.661029] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 82051f94-9eeb-470d-aa42-9e827049069f: rpc.has_security_group_logging(os_id): False [ 851.686059] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.686059] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.701235] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.701456] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.713171] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.713171] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.721031] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.721031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.721509] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.721637] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8b9ce1a-2b8e-4a65-b28c-620181c45204 is going to be deleted. [ 851.723525] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.723662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.723727] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.723980] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.725781] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.725955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.730027] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.730027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.730027] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.730027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.730027] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.730027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.730027] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.730583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.730893] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.731034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.759022] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb749722-17ca-41f8-9be5-6aa59fad95b3 in Status: SUCCESS [ 851.759022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.759022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.759022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.759022] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.759022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.759022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.759022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.759022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.759022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.759022] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb749722-17ca-41f8-9be5-6aa59fad95b3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.760987] env[69920]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 851.761512] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.761630] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b4fb140-8d8f-45fe-9d42-7405286ea87b is going to be deleted. [ 851.762645] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.762881] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.764369] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6054485-180a-4f29-a65a-3151187db51e taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.764457] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.764621] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff1455ee-4ab2-4e4d-ac72-6a6554002936 with status ACTIVE [ 851.764803] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.766808] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.766808] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.766808] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.766808] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.766808] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.766808] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.766808] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.766808] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.766808] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.766808] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.766808] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.766808] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.766808] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.766808] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.766808] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff1455ee-4ab2-4e4d-ac72-6a6554002936 is going to be updated. [ 851.768503] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.768632] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.808684] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.808843] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.808930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.809164] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.810416] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.810416] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff1455ee-4ab2-4e4d-ac72-6a6554002936" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.810416] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.810599] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e5cbff-80b3-432a-81ac-0bf4249c4679 is going to be deleted. [ 851.811423] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.811634] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.819870] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.819943] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.855602] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.855602] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8772ae4d-b3d8-4986-b291-e37049ac05b0 is going to be deleted. [ 851.856962] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.857270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.898027] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.898027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.913192] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.913354] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 is going to be deleted. [ 851.915969] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.916251] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.929276] env[69920]: INFO networking_nsxv3.common.synchronization [None req-64abf28e-d37a-4ce0-9c8e-2f236bdb601b tempest-ServersV294TestFqdnHostnames-1367069286 tempest-ServersV294TestFqdnHostnames-1367069286-project-member] Enqueued Resource ID: 4d847f61-da82-4a79-82ae-c393059854e9 with Priority: HIGHEST for action security_group_rules [ 851.930593] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.930902] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.931755] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d847f61-da82-4a79-82ae-c393059854e9 with Priority: HIGHEST for action security_group_rules [ 851.932129] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d847f61-da82-4a79-82ae-c393059854e9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.932278] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.932347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.932667] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.932756] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d847f61-da82-4a79-82ae-c393059854e9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.999496] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.999708] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5 is going to be deleted. [ 852.001272] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.001539] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.003446] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.003619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.041256] env[69920]: INFO networking_nsxv3.common.synchronization [None req-7d5b48fb-7737-49e5-85cf-8d3184c2f581 tempest-ServersV294TestFqdnHostnames-1367069286 tempest-ServersV294TestFqdnHostnames-1367069286-project-member] Enqueued Resource ID: 4d847f61-da82-4a79-82ae-c393059854e9 with Priority: HIGHEST for action security_group_rules [ 852.041881] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d847f61-da82-4a79-82ae-c393059854e9 with Priority: HIGHEST for action security_group_rules [ 852.042244] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d847f61-da82-4a79-82ae-c393059854e9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.042304] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.080527] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.080686] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be deleted. [ 852.081970] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.082069] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.084156] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6124cb4-db5b-4093-b85f-7d68bc614215: rpc.has_security_group_logging(os_id): False [ 852.108159] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-40f3bd9f-8637-49e8-92cd-03812c846cfd taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.109985] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.109985] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.109985] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.109985] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.109985] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.109985] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.110305] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.110305] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.110305] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.111020] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-40f3bd9f-8637-49e8-92cd-03812c846cfd taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.111184] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.111262] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.111470] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.111620] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.111750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.111831] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.112017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.112133] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.112231] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.112327] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.137424] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.137636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.137716] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.138010] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.138223] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.138381] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.138458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.138667] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.138731] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.138821] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.139050] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.139307] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.139371] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.139525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.139684] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.139780] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.139858] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.140015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.140100] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.140218] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.140350] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.141410] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e86ba42-7c29-4732-915b-33713b63d0b7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.148075] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9141c37-2b91-4c20-add2-e8a0090bfc23',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.154402] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.154402] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.164090] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.164263] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.164315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.165383] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.165383] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.165383] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.165383] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.165383] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.165383] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.165383] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.165891] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.165891] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.165891] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.165891] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.165891] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.166116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.166116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.166196] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.166253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.167128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.167128] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c19f5e9b-e818-4af4-9417-0ddc1f2e116c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.178750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.179228] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 667ad5b8-40a7-4438-a71d-51999e9b972e is going to be deleted. [ 852.180405] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.180636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.201082] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.201311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.223394] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.223619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.242159] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.242417] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c27221ee-5342-4aa7-83da-a28291a2021a is going to be deleted. [ 852.243465] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.243833] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.262087] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb749722-17ca-41f8-9be5-6aa59fad95b3 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.262087] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.262087] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.262087] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.262390] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.262390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.262390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.262499] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.262541] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.262631] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.262781] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb749722-17ca-41f8-9be5-6aa59fad95b3 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.262874] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.262939] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.263097] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.263238] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.263330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.263391] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.263528] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.263607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.263690] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.263779] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb749722-17ca-41f8-9be5-6aa59fad95b3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.276982] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.276982] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.311142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.311349] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0da8b432-7927-4b3d-81a7-f990d2563525 is going to be deleted. [ 852.313054] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.313305] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.342848] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.343040] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.390751] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.390900] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 is going to be deleted. [ 852.394493] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.394493] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.414197] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.414197] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.463227] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.464230] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.464230] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.464230] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.464230] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.464230] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.464230] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82051f94-9eeb-470d-aa42-9e827049069f is going to be updated. [ 852.466258] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.466258] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.466258] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.466258] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5de6d9e1-a1f1-4a2f-8fd9-6e18a81cefbc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.466258] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.466520] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.466520] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.466660] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8b9ce1a-2b8e-4a65-b28c-620181c45204" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.466846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.467025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.467126] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.467286] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b4fb140-8d8f-45fe-9d42-7405286ea87b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.467427] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.467608] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.467702] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.467852] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e5cbff-80b3-432a-81ac-0bf4249c4679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.468490] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.468690] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.468809] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.468949] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8772ae4d-b3d8-4986-b291-e37049ac05b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.469118] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.469290] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.524816] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.525328] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.535510] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.535669] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.542021] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.542021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.549411] env[69920]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 852.550303] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.550651] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.550801] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.550890] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.551175] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.551474] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.551627] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6124cb4-db5b-4093-b85f-7d68bc614215 is going to be updated. [ 852.553214] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.553723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.553723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.553723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fefa64c6-3adc-4e08-a393-e1f1a8b4a1b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.553885] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.554083] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.554567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.554714] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.554886] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.555137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.555209] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.555335] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-667ad5b8-40a7-4438-a71d-51999e9b972e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.555453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.555597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.555674] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.556390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c27221ee-5342-4aa7-83da-a28291a2021a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.556851] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.557032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.557142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.557290] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.557389] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.557565] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.557685] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.557799] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d847f61-da82-4a79-82ae-c393059854e9 already deleted. [ 852.557889] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.558046] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.558198] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.558276] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.558382] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0da8b432-7927-4b3d-81a7-f990d2563525" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.558493] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.558631] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.558704] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.558812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.558925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.559154] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.559260] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d847f61-da82-4a79-82ae-c393059854e9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.615105] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40f3bd9f-8637-49e8-92cd-03812c846cfd: rpc.has_security_group_logging(os_id): False [ 852.622937] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6054485-180a-4f29-a65a-3151187db51e in Status: SUCCESS [ 852.622937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.625023] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 in Status: SUCCESS [ 852.625023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.625023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.625023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.628406] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.628965] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.628965] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.628965] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.628965] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.629162] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6054485-180a-4f29-a65a-3151187db51e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.629904] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.630804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.630804] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.630804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.630804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.630804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.630804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.630804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.631078] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6cbc5f86-4dd3-4809-8201-0103be329ab2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.632398] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: SUCCESS [ 852.632598] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.632751] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.632952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.633157] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.633263] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.633333] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.633504] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.633581] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.633672] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.633842] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.633936] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.634024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.634167] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.634301] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.634387] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.634442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.634570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.634639] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.634713] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.634798] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.644352] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e86ba42-7c29-4732-915b-33713b63d0b7: rpc.has_security_group_logging(os_id): False [ 852.645514] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f: rpc.has_security_group_logging(os_id): False [ 852.651105] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9141c37-2b91-4c20-add2-e8a0090bfc23: rpc.has_security_group_logging(os_id): False [ 852.668581] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c19f5e9b-e818-4af4-9417-0ddc1f2e116c: rpc.has_security_group_logging(os_id): False [ 852.691363] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.691505] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.691572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.691791] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.691937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.704206] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.704359] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.704429] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.704657] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.707633] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.707747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.714552] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.714552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.714552] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.714552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.718018] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.718018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.742160] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82051f94-9eeb-470d-aa42-9e827049069f in Status: IN_PROGRESS for 2s [ 852.766520] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.766866] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.766973] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.766973] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.767331] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.767331] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.767519] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.767816] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.767816] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.767816] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.768017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.768091] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.768171] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.768248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.769497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.769497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.769497] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd is going to be updated. [ 852.771612] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb749722-17ca-41f8-9be5-6aa59fad95b3: rpc.has_security_group_logging(os_id): False [ 852.772759] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.772973] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.774989] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.774989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.808049] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.808174] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.834052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.834052] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.834052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.834052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.834052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.834052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.834052] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.834052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.834052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.834052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.834052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.834052] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.834052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.834052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.835165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.835165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.835165] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c is going to be updated. [ 852.835573] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.835742] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.897579] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.898863] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.898863] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.898863] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.898863] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.898863] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.898863] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 is going to be updated. [ 852.901546] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.902108] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.949347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.949703] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.949811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.949925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.950185] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.950282] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.950408] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 is going to be updated. [ 852.951503] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.951706] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.951847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.952033] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.953822] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.953902] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.954142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.956185] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.956185] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.956185] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.956185] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.956185] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.956185] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.956185] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.956185] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.956185] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.956185] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.956185] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.956185] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb749722-17ca-41f8-9be5-6aa59fad95b3 is going to be created. [ 852.956736] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.957709] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.958816] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.958982] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.988515] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.988577] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.988691] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.988791] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.989047] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.989164] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.989417] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.989544] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.989639] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.989852] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.989967] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.990212] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.990314] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.990390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.990577] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.990675] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.990802] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f is going to be updated. [ 852.992029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.992244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.992417] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.993600] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.993754] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.993896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.018205] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6124cb4-db5b-4093-b85f-7d68bc614215 in Status: IN_PROGRESS for 2s [ 853.019824] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.019990] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.020134] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.020389] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.020532] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.032979] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd in Status: IN_PROGRESS for 2s [ 853.040316] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 in Status: IN_PROGRESS for 2s [ 853.136700] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6cbc5f86-4dd3-4809-8201-0103be329ab2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.137910] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6054485-180a-4f29-a65a-3151187db51e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.138859] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e31e2ae5-2f08-403b-b19a-697a36f3cb16: rpc.has_security_group_logging(os_id): False [ 853.337025] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.337025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.337025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.337025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.337025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.353034] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.353034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.353034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.353034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.353034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.355057] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.355484] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.355714] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.356096] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.356296] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.356523] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d847f61-da82-4a79-82ae-c393059854e9 already deleted. [ 853.356774] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.358128] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.358455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.358623] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.359040] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.359343] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.361757] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.362126] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.362367] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.362739] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.367207] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 in Status: IN_PROGRESS for 2s [ 853.371571] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c in Status: IN_PROGRESS for 2s [ 853.386173] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.386173] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.432732] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb749722-17ca-41f8-9be5-6aa59fad95b3 in Status: IN_PROGRESS for 2s [ 853.476332] env[69920]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 853.476332] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.476332] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.476332] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.476332] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.476332] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.476332] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.476332] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.476332] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.476942] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.477365] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.481024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.481024] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.481024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.481024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.481024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.481024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.481024] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 is going to be updated. [ 853.481024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.481024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.481024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.521777] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f in Status: IN_PROGRESS for 2s [ 853.639403] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6cbc5f86-4dd3-4809-8201-0103be329ab2: rpc.has_security_group_logging(os_id): False [ 853.641160] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6054485-180a-4f29-a65a-3151187db51e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.683332] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.684268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.684434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.686425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.691880] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.691962] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.769533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.769832] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.769934] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.770067] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.770237] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.770323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.770408] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 is going to be updated. [ 853.771623] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.771811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.771957] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.792327] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: IN_PROGRESS for 2s [ 853.865866] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.866048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.866181] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.866410] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.866551] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.893162] env[69920]: INFO networking_nsxv3.common.synchronization [None req-3f7138e5-a1b5-4184-becb-9d65cb6fd19a None None] Enqueued Resource ID: 6ba05746-f54e-42e1-b020-4a9016e18807 with Priority: HIGHEST for action port [ 853.893421] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba05746-f54e-42e1-b020-4a9016e18807 with Priority: HIGHEST for action port [ 853.894055] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ba05746-f54e-42e1-b020-4a9016e18807 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.894444] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ba05746-f54e-42e1-b020-4a9016e18807" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.894444] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ba05746-f54e-42e1-b020-4a9016e18807" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.894561] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ba05746-f54e-42e1-b020-4a9016e18807" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.894675] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ba05746-f54e-42e1-b020-4a9016e18807',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.897484] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 in Status: IN_PROGRESS for 2s [ 854.147158] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.147158] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.148229] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.148229] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.148229] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.148229] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6054485-180a-4f29-a65a-3151187db51e is going to be updated. [ 854.191203] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.191334] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.191413] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.191668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.191865] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.212412] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6054485-180a-4f29-a65a-3151187db51e in Status: IN_PROGRESS for 2s [ 854.397292] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ba05746-f54e-42e1-b020-4a9016e18807 [ 854.397561] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.397681] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.397845] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.398011] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.398126] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.398229] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ba05746-f54e-42e1-b020-4a9016e18807 already deleted. [ 854.398314] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ba05746-f54e-42e1-b020-4a9016e18807" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.763888] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82051f94-9eeb-470d-aa42-9e827049069f in Status: SUCCESS [ 854.764169] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.036031] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6124cb4-db5b-4093-b85f-7d68bc614215 in Status: SUCCESS [ 855.036284] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.048659] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd in Status: SUCCESS [ 855.048989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.058998] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 in Status: SUCCESS [ 855.059259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.386671] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 in Status: SUCCESS [ 855.387053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.392912] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c in Status: SUCCESS [ 855.393165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.448817] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb749722-17ca-41f8-9be5-6aa59fad95b3 in Status: SUCCESS [ 855.448817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.535160] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f in Status: SUCCESS [ 855.535411] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.809829] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: SUCCESS [ 855.809829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.809829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.809829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.809829] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.918556] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 in Status: SUCCESS [ 855.918556] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.918556] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.918978] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.918978] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cbc5f86-4dd3-4809-8201-0103be329ab2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.249244] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6054485-180a-4f29-a65a-3151187db51e in Status: SUCCESS [ 856.249717] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.250107] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.250277] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.250517] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.250779] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.250895] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.251115] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.251234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.251349] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.251466] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6054485-180a-4f29-a65a-3151187db51e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.312573] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.312769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.312824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.313180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.313355] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.313463] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.313529] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.313685] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.313776] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.313878] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.313962] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.369139] env[69920]: INFO networking_nsxv3.common.synchronization [req-bcde0ca9-2ec6-429f-bfec-0be2d3d08d8f req-b4d92320-c752-4f14-9ea2-0a0668d0384f tempest-MigrationsAdminTest-685805879 tempest-MigrationsAdminTest-685805879-project-member] Enqueued Resource ID: 6440e2db-5336-4fd7-b450-468fa8f78560 with Priority: HIGHEST for action security_group_members [ 856.369139] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6440e2db-5336-4fd7-b450-468fa8f78560 with Priority: HIGHEST for action security_group_members [ 856.369452] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6440e2db-5336-4fd7-b450-468fa8f78560 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.369580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.369644] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.372600] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.372600] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.372600] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.372600] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.372600] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.372600] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.372600] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6440e2db-5336-4fd7-b450-468fa8f78560',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.423649] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cbc5f86-4dd3-4809-8201-0103be329ab2 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.423649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.423649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.424013] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.424013] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.424013] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.424119] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.424209] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.424302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.424393] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.424485] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6cbc5f86-4dd3-4809-8201-0103be329ab2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.736372] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-207 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.736372] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.736372] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.736573] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.736778] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.736863] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.737180] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.739068] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.739068] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.739068] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 856.739068] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 856.739068] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 856.739068] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 856.739622] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 856.739622] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 856.739622] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 856.754245] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6054485-180a-4f29-a65a-3151187db51e taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.754405] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.754479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.754700] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.754868] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.755010] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.755104] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.755264] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.755354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.755442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.755592] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6054485-180a-4f29-a65a-3151187db51e taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.755685] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.755746] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.755888] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.756055] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.756157] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.756273] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.756471] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.756571] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.756657] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.756750] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6054485-180a-4f29-a65a-3151187db51e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.762417] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 856.762417] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 856.762417] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 856.762417] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.762417] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-32049b49-d761-48ff-8938-d76ebe86f62e taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.762417] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-32049b49-d761-48ff-8938-d76ebe86f62e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.762417] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-32049b49-d761-48ff-8938-d76ebe86f62e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.762861] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-32049b49-d761-48ff-8938-d76ebe86f62e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.762861] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32049b49-d761-48ff-8938-d76ebe86f62e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.820497] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.820497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.820497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.820497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.820497] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.820497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.820497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.820497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.820497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.820497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.820497] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.820497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.820497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.820497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.820497] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.820497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.821510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.821510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.821510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.821510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.821510] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.875028] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6440e2db-5336-4fd7-b450-468fa8f78560',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.928139] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6cbc5f86-4dd3-4809-8201-0103be329ab2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.261369] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6054485-180a-4f29-a65a-3151187db51e: rpc.has_security_group_logging(os_id): False [ 857.265867] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.266024] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.266107] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.266396] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.266569] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.266749] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 32049b49-d761-48ff-8938-d76ebe86f62e not found, creating... [ 857.267034] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.267196] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.267316] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.267544] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.267685] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.267974] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.268304] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.268429] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.269291] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.269291] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.269291] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 32049b49-d761-48ff-8938-d76ebe86f62e is going to be created. [ 857.281207] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.281480] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.281480] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.282153] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.299606] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.299754] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.299883] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.300222] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.300467] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.300699] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-32049b49-d761-48ff-8938-d76ebe86f62e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.304104] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.305103] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.305103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.305103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.305103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.305103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.305103] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.305507] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.305507] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.305507] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.305507] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.305671] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.305729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.305774] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.305885] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.305963] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.306072] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6054485-180a-4f29-a65a-3151187db51e is going to be updated. [ 857.324721] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e31e2ae5-2f08-403b-b19a-697a36f3cb16: rpc.has_security_group_logging(os_id): False [ 857.352022] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.352022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.352022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.352022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.352022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.352022] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.352022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.352022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.352022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.352022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.352022] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.352022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.352022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.352022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.352022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.353015] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.353287] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.353443] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.353682] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.353852] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.354030] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 is going to be updated. [ 857.378269] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6440e2db-5336-4fd7-b450-468fa8f78560',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.429817] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.429817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.429817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.429817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.429817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.442107] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6cbc5f86-4dd3-4809-8201-0103be329ab2: rpc.has_security_group_logging(os_id): False [ 857.458811] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6054485-180a-4f29-a65a-3151187db51e in Status: IN_PROGRESS for 2s [ 857.480143] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.480143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.480143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.480143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.480143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.480143] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.480143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.480143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.480143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.480143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.480143] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 is going to be updated. [ 857.593816] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.593991] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.594074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.594325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.594445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.626912] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: IN_PROGRESS for 2s [ 857.634363] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.634562] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.634632] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.634850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.635143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.665552] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 in Status: IN_PROGRESS for 2s [ 857.880392] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.880990] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.881103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.881369] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.881501] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.882707] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6440e2db-5336-4fd7-b450-468fa8f78560 is going to be updated. [ 857.926697] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.926849] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.927034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.927211] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.927375] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.939521] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6440e2db-5336-4fd7-b450-468fa8f78560 in Status: IN_PROGRESS for 2s [ 858.043300] env[69920]: INFO networking_nsxv3.common.synchronization [req-bcde0ca9-2ec6-429f-bfec-0be2d3d08d8f req-b9970a21-c477-4b65-ade9-e5cd58d70f47 service nova] Enqueued Resource ID: 6440e2db-5336-4fd7-b450-468fa8f78560 with Priority: HIGHEST for action security_group_rules [ 858.043571] env[69920]: INFO networking_nsxv3.common.synchronization [req-bcde0ca9-2ec6-429f-bfec-0be2d3d08d8f req-b9970a21-c477-4b65-ade9-e5cd58d70f47 service nova] Enqueued Resource ID: 6440e2db-5336-4fd7-b450-468fa8f78560 with Priority: HIGHEST for action security_group_members [ 858.043721] env[69920]: INFO networking_nsxv3.common.synchronization [req-bcde0ca9-2ec6-429f-bfec-0be2d3d08d8f req-b9970a21-c477-4b65-ade9-e5cd58d70f47 service nova] Enqueued Resource ID: 32049b49-d761-48ff-8938-d76ebe86f62e with Priority: HIGHEST for action port [ 858.045068] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6440e2db-5336-4fd7-b450-468fa8f78560 with Priority: HIGHEST for action security_group_rules [ 858.045239] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6440e2db-5336-4fd7-b450-468fa8f78560 with Priority: HIGHEST for action security_group_members [ 858.045343] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32049b49-d761-48ff-8938-d76ebe86f62e with Priority: HIGHEST for action port [ 858.045643] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6440e2db-5336-4fd7-b450-468fa8f78560 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.045781] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.045834] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.046061] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.046248] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6440e2db-5336-4fd7-b450-468fa8f78560',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.052022] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6440e2db-5336-4fd7-b450-468fa8f78560 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.052022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.052022] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-32049b49-d761-48ff-8938-d76ebe86f62e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.052022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32049b49-d761-48ff-8938-d76ebe86f62e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.052022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32049b49-d761-48ff-8938-d76ebe86f62e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.052022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32049b49-d761-48ff-8938-d76ebe86f62e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.052022] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32049b49-d761-48ff-8938-d76ebe86f62e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.529646] env[69920]: INFO networking_nsxv3.common.synchronization [req-99ed1abd-90ad-4b07-b829-cf33449910df req-f635d53f-c674-41b4-a25f-0410da971414 tempest-ServersNegativeTestMultiTenantJSON-908142255 tempest-ServersNegativeTestMultiTenantJSON-908142255-project-member] Enqueued Resource ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c with Priority: HIGHEST for action security_group_members [ 858.530222] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c with Priority: HIGHEST for action security_group_members [ 858.530541] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.530677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.530772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.532476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.532476] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.532476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.532476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.532476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.532476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.532476] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c19f5e9b-e818-4af4-9417-0ddc1f2e116c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.554585] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6440e2db-5336-4fd7-b450-468fa8f78560 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.555339] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.555597] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32049b49-d761-48ff-8938-d76ebe86f62e with status ACTIVE [ 858.555813] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.556039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.556190] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.556444] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.556587] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.556873] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.559135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.559135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.559135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.559135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.559135] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.559135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.559135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.559135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.559135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.559135] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32049b49-d761-48ff-8938-d76ebe86f62e is going to be updated. [ 858.584139] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.584139] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.584401] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.584466] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.584688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.584753] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32049b49-d761-48ff-8938-d76ebe86f62e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.034653] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.036091] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.036091] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.039094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.039094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.039094] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.039094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.039094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.039094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.039094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.039094] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c is going to be updated. [ 859.081418] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.081418] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.081418] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.081418] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.081418] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.094442] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c in Status: IN_PROGRESS for 2s [ 859.474147] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6054485-180a-4f29-a65a-3151187db51e in Status: SUCCESS [ 859.474417] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.645976] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: SUCCESS [ 859.646280] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.685466] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 in Status: SUCCESS [ 859.685714] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.963864] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6440e2db-5336-4fd7-b450-468fa8f78560 in Status: SUCCESS [ 859.964422] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.964422] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.964650] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.964839] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.964963] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.965054] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.965234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.965320] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.965420] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6440e2db-5336-4fd7-b450-468fa8f78560',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.215118] env[69920]: INFO networking_nsxv3.common.synchronization [req-c542397f-7835-4329-a377-f9575d7e5abd req-5c101c7d-d59d-43da-9273-b550e87860b5 tempest-ServersTestJSON-2147431032 tempest-ServersTestJSON-2147431032-project-member] Enqueued Resource ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 with Priority: HIGHEST for action security_group_members [ 860.215766] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 with Priority: HIGHEST for action security_group_members [ 860.216217] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e86ba42-7c29-4732-915b-33713b63d0b7 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.216429] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.216546] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.216812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.217061] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.217323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.217431] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.217642] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.217789] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.217935] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e86ba42-7c29-4732-915b-33713b63d0b7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.237020] env[69920]: INFO networking_nsxv3.common.synchronization [req-6075f799-2836-4c3b-8ddc-523b91e28aa6 req-26086ed7-b5a6-4a70-be10-91c7bddffcb2 tempest-TenantUsagesTestJSON-1584323566 tempest-TenantUsagesTestJSON-1584323566-project-member] Enqueued Resource ID: fb749722-17ca-41f8-9be5-6aa59fad95b3 with Priority: HIGHEST for action security_group_members [ 860.238243] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb749722-17ca-41f8-9be5-6aa59fad95b3 with Priority: HIGHEST for action security_group_members [ 860.238725] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb749722-17ca-41f8-9be5-6aa59fad95b3 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.238904] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.239013] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.239273] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.239482] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.239634] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.241169] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.241431] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.241568] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.241705] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb749722-17ca-41f8-9be5-6aa59fad95b3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.470106] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6440e2db-5336-4fd7-b450-468fa8f78560',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.720089] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.720617] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.720617] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.720746] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.720857] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.721172] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.721347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.721415] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.721674] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.721774] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.721868] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 is going to be updated. [ 860.745695] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.746171] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.746171] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.746425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.746570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.746876] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.747039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.747145] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.747382] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.747503] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.747640] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb749722-17ca-41f8-9be5-6aa59fad95b3 is going to be updated. [ 860.753996] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.754257] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.754370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.754645] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.755566] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.767822] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 in Status: IN_PROGRESS for 2s [ 860.791211] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.791448] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.791555] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.791852] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.793197] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.816955] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb749722-17ca-41f8-9be5-6aa59fad95b3 in Status: IN_PROGRESS for 2s [ 860.972960] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6440e2db-5336-4fd7-b450-468fa8f78560',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.107631] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c in Status: SUCCESS [ 861.107631] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c deletion is rescheduled due to dependency. [ 861.107631] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.475656] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.475847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.475893] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.476165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.476528] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.476528] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6440e2db-5336-4fd7-b450-468fa8f78560 is going to be updated. [ 861.537679] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.537679] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.537679] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.537679] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.537679] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.549084] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6440e2db-5336-4fd7-b450-468fa8f78560 in Status: IN_PROGRESS for 2s [ 861.886396] env[69920]: INFO networking_nsxv3.common.synchronization [req-4a51a10f-ad24-4cc4-8eed-ce2af1886978 req-a161362c-0248-41f6-b0bb-bdea46f33d42 tempest-ListImageFiltersTestJSON-1014675120 tempest-ListImageFiltersTestJSON-1014675120-project-member] Enqueued Resource ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f with Priority: HIGHEST for action security_group_members [ 861.887765] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f with Priority: HIGHEST for action security_group_members [ 861.888020] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.888020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.888149] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.888278] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.888433] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.888536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.888625] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.889027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.889027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.889027] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.138433] env[69920]: INFO networking_nsxv3.common.synchronization [None req-a8747071-a81c-4baf-8c3d-747801006ab5 tempest-ImagesOneServerNegativeTestJSON-924528592 tempest-ImagesOneServerNegativeTestJSON-924528592-project-member] Enqueued Resource ID: 462a9c89-066b-4986-a5a9-65fec75b129e with Priority: HIGHEST for action security_group_rules [ 862.138970] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 462a9c89-066b-4986-a5a9-65fec75b129e with Priority: HIGHEST for action security_group_rules [ 862.139329] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-462a9c89-066b-4986-a5a9-65fec75b129e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.139473] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-462a9c89-066b-4986-a5a9-65fec75b129e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.139544] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-462a9c89-066b-4986-a5a9-65fec75b129e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.139816] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-462a9c89-066b-4986-a5a9-65fec75b129e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.139910] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('462a9c89-066b-4986-a5a9-65fec75b129e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.247038] env[69920]: INFO networking_nsxv3.common.synchronization [None req-596bff9b-5a71-486b-ac32-12f9f2d96bd0 tempest-ImagesOneServerNegativeTestJSON-924528592 tempest-ImagesOneServerNegativeTestJSON-924528592-project-member] Enqueued Resource ID: 462a9c89-066b-4986-a5a9-65fec75b129e with Priority: HIGHEST for action security_group_rules [ 862.247625] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 462a9c89-066b-4986-a5a9-65fec75b129e with Priority: HIGHEST for action security_group_rules [ 862.247976] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-462a9c89-066b-4986-a5a9-65fec75b129e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.248114] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-462a9c89-066b-4986-a5a9-65fec75b129e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.394981] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.395252] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.395319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.395961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.395961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.396527] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.396527] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.396527] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.396527] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.398529] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.398529] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f is going to be updated. [ 862.442286] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.442385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.442385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.443039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.443039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.458526] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f in Status: IN_PROGRESS for 2s [ 862.671414] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.671414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.671414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.671414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.671414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.673012] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 462a9c89-066b-4986-a5a9-65fec75b129e already deleted. [ 862.673119] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-462a9c89-066b-4986-a5a9-65fec75b129e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.673404] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-462a9c89-066b-4986-a5a9-65fec75b129e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.673710] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-462a9c89-066b-4986-a5a9-65fec75b129e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.673903] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('462a9c89-066b-4986-a5a9-65fec75b129e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.778710] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 in Status: SUCCESS [ 862.778999] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 deletion is rescheduled due to dependency. [ 862.779144] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.827436] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb749722-17ca-41f8-9be5-6aa59fad95b3 in Status: SUCCESS [ 862.827639] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb749722-17ca-41f8-9be5-6aa59fad95b3 deletion is rescheduled due to dependency. [ 862.827793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.207545] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.208597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.208597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.208597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.208597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.208597] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 462a9c89-066b-4986-a5a9-65fec75b129e already deleted. [ 863.208597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-462a9c89-066b-4986-a5a9-65fec75b129e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.559704] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6440e2db-5336-4fd7-b450-468fa8f78560 in Status: SUCCESS [ 863.559917] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.560197] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.560329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.560576] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.560638] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.560717] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.560850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.560932] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.561081] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.561140] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6440e2db-5336-4fd7-b450-468fa8f78560',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.064133] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6440e2db-5336-4fd7-b450-468fa8f78560 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.064463] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.064653] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.064953] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.065274] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.065419] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.065509] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.065736] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.065860] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.065983] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.066216] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6440e2db-5336-4fd7-b450-468fa8f78560 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.066355] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.066439] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.066651] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.066841] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.067040] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.067108] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.067243] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.067352] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.067467] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.067583] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6440e2db-5336-4fd7-b450-468fa8f78560',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.419405] env[69920]: INFO networking_nsxv3.common.synchronization [req-acc5888d-c835-47f3-8f87-e0d308dd93ee req-419e1dcd-3667-4b24-8879-8510a319b8be tempest-DeleteServersTestJSON-1690074738 tempest-DeleteServersTestJSON-1690074738-project-member] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 864.420686] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 864.421016] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.421143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.421211] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.422029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.422029] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.422029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.422029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.422029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.422029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.422029] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.470318] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f in Status: SUCCESS [ 864.470504] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f deletion is rescheduled due to dependency. [ 864.470614] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.569789] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6440e2db-5336-4fd7-b450-468fa8f78560: rpc.has_security_group_logging(os_id): False [ 864.591676] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.591676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.591676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.591676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.618437] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.618717] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.618840] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.618896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.619126] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.619219] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.619412] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.619511] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.619558] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.619715] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.619783] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.619977] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.620085] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.620136] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.620280] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.620347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.620439] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6440e2db-5336-4fd7-b450-468fa8f78560 is going to be updated. [ 864.693556] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.693707] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.693778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.693994] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.694157] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.715496] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6440e2db-5336-4fd7-b450-468fa8f78560 in Status: IN_PROGRESS for 2s [ 864.749553] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-105 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.749553] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.750223] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.750347] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.750626] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.750790] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.750909] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.751400] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.751504] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.751724] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 864.752831] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 864.752831] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 864.752831] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 864.752831] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 864.752831] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 864.752831] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 864.775791] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 864.775791] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 864.775791] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 864.776106] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.776845] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-0a3c7cb5-f42d-407f-8561-e9c2695bced8 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.776845] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-0a3c7cb5-f42d-407f-8561-e9c2695bced8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.777057] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-0a3c7cb5-f42d-407f-8561-e9c2695bced8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.777394] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-0a3c7cb5-f42d-407f-8561-e9c2695bced8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.777717] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a3c7cb5-f42d-407f-8561-e9c2695bced8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.924551] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.924797] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.924797] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.925055] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.925250] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.925544] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.925836] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.925836] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.926079] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.926266] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.926322] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be deleted. [ 864.979804] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.979804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.979804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.980152] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.980152] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.980224] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.280940] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.281253] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.281338] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.281631] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.281789] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.281948] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 0a3c7cb5-f42d-407f-8561-e9c2695bced8 not found, creating... [ 865.282240] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.282398] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.282518] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.282747] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.282894] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.283225] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.283394] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.283517] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.283739] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.283921] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.284034] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 0a3c7cb5-f42d-407f-8561-e9c2695bced8 is going to be created. [ 865.311202] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.311202] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.311202] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.311518] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.311901] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.312303] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-0a3c7cb5-f42d-407f-8561-e9c2695bced8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.034424] env[69920]: INFO networking_nsxv3.common.synchronization [req-acc5888d-c835-47f3-8f87-e0d308dd93ee req-7f9b9fba-e05a-48d8-bcc5-28093ab7d5db service nova] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_rules [ 866.034664] env[69920]: INFO networking_nsxv3.common.synchronization [req-acc5888d-c835-47f3-8f87-e0d308dd93ee req-7f9b9fba-e05a-48d8-bcc5-28093ab7d5db service nova] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 866.034697] env[69920]: INFO networking_nsxv3.common.synchronization [req-acc5888d-c835-47f3-8f87-e0d308dd93ee req-7f9b9fba-e05a-48d8-bcc5-28093ab7d5db service nova] Enqueued Resource ID: 0a3c7cb5-f42d-407f-8561-e9c2695bced8 with Priority: HIGHEST for action port [ 866.034919] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_rules [ 866.035057] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 866.035217] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a3c7cb5-f42d-407f-8561-e9c2695bced8 with Priority: HIGHEST for action port [ 866.036228] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.036430] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.036691] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.036965] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.037133] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.038175] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.038435] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.038535] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.038749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.039120] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.039325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.039458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.039634] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.039791] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.040876] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.040876] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a3c7cb5-f42d-407f-8561-e9c2695bced8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.040876] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a3c7cb5-f42d-407f-8561-e9c2695bced8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.040876] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a3c7cb5-f42d-407f-8561-e9c2695bced8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.041341] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a3c7cb5-f42d-407f-8561-e9c2695bced8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.041473] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a3c7cb5-f42d-407f-8561-e9c2695bced8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.545730] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.546833] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.546942] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.547142] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a3c7cb5-f42d-407f-8561-e9c2695bced8 with status ACTIVE [ 866.547410] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.547410] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.547534] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.547668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.547754] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.547917] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.548021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.548084] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.548243] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.548320] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.548498] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.550922] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.551045] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.551263] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.551384] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.553181] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a3c7cb5-f42d-407f-8561-e9c2695bced8 is going to be updated. [ 866.576034] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.576034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.576034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.576034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.576034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.576034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a3c7cb5-f42d-407f-8561-e9c2695bced8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.732793] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6440e2db-5336-4fd7-b450-468fa8f78560 in Status: SUCCESS [ 866.732793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.055533] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.089812] env[69920]: INFO networking_nsxv3.common.synchronization [req-503ff1f2-5a45-4852-80c5-7699d24d401d req-371140de-bb7a-48ef-9c34-870c1f31c72a tempest-ServerDiskConfigTestJSON-714416826 tempest-ServerDiskConfigTestJSON-714416826-project-member] Enqueued Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 867.090402] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 867.090743] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.092457] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.092576] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.093031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.093031] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.093217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.093217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.094426] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.094426] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.094426] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.435159] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-538 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.435396] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-538" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.435766] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-538" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.436178] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-538" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.437015] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.437279] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.437809] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.437809] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.438013] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.438322] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.438572] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 867.438711] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 867.438875] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 867.439072] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 867.439453] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 867.439493] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.462791] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.463059] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 867.463266] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.463540] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-538" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.463967] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-b590e270-89a9-47f6-8e4e-69b428b381a8 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.464229] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-b590e270-89a9-47f6-8e4e-69b428b381a8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.464424] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-b590e270-89a9-47f6-8e4e-69b428b381a8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.464891] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-b590e270-89a9-47f6-8e4e-69b428b381a8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.465155] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b590e270-89a9-47f6-8e4e-69b428b381a8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.560040] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.560200] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.560200] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.560461] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.560557] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.560926] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be created. [ 867.587031] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.587031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.587031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.587031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.587031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.598049] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.598049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.598049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.598049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.598049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.598049] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.598049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.598049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.598049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.598049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.598049] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 is going to be deleted. [ 867.600987] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: UNINITIALIZED for 2s [ 867.646521] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.646711] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.646711] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.646896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.647022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.647098] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.969273] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.969273] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.969273] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.969685] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.970031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.970379] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port b590e270-89a9-47f6-8e4e-69b428b381a8 not found, creating... [ 867.970849] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.971195] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.971395] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.971723] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.971945] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.972361] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.972684] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.972806] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.973145] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.973587] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.973587] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: b590e270-89a9-47f6-8e4e-69b428b381a8 is going to be created. [ 868.000024] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.000024] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.000024] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.000024] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.000024] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.000024] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-b590e270-89a9-47f6-8e4e-69b428b381a8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.726888] env[69920]: INFO networking_nsxv3.common.synchronization [req-503ff1f2-5a45-4852-80c5-7699d24d401d req-de410bc7-cddf-4796-a792-5c3bcde4ad3c service nova] Enqueued Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_rules [ 868.727176] env[69920]: INFO networking_nsxv3.common.synchronization [req-503ff1f2-5a45-4852-80c5-7699d24d401d req-de410bc7-cddf-4796-a792-5c3bcde4ad3c service nova] Enqueued Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 868.727316] env[69920]: INFO networking_nsxv3.common.synchronization [req-503ff1f2-5a45-4852-80c5-7699d24d401d req-de410bc7-cddf-4796-a792-5c3bcde4ad3c service nova] Enqueued Resource ID: b590e270-89a9-47f6-8e4e-69b428b381a8 with Priority: HIGHEST for action port [ 868.727923] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_rules [ 868.728453] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 868.728453] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b590e270-89a9-47f6-8e4e-69b428b381a8 with Priority: HIGHEST for action port [ 868.728767] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.728901] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.728990] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.729358] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.729487] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.731130] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.731130] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.731130] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.735021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.735021] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.735021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.735021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.735021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.735021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.735021] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.735021] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-b590e270-89a9-47f6-8e4e-69b428b381a8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.735021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b590e270-89a9-47f6-8e4e-69b428b381a8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.735021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b590e270-89a9-47f6-8e4e-69b428b381a8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.735021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b590e270-89a9-47f6-8e4e-69b428b381a8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.735021] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b590e270-89a9-47f6-8e4e-69b428b381a8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.239260] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b590e270-89a9-47f6-8e4e-69b428b381a8 with status ACTIVE [ 869.239591] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.239792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.239926] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.240249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.240391] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.240681] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.240845] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.240955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.241195] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.241332] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.242268] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.242393] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.242465] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.242602] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.242682] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.242773] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b590e270-89a9-47f6-8e4e-69b428b381a8 is going to be updated. [ 869.243999] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.244196] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.244293] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.267295] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.267564] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.267697] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.267993] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.268204] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.268347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b590e270-89a9-47f6-8e4e-69b428b381a8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.613078] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: SUCCESS [ 869.613474] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.613585] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.613821] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.613953] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.614079] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.614139] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.614328] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.614414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.614468] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.614561] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.746619] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.902174] env[69920]: INFO networking_nsxv3.common.synchronization [req-6170d672-b086-4770-8dae-caf23df0c129 req-68fd1ab2-c812-4df1-882b-226fe1246206 tempest-ImagesTestJSON-210893687 tempest-ImagesTestJSON-210893687-project-member] Enqueued Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 869.902849] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 869.906150] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.906150] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.906150] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.906150] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.906150] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.906150] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.906150] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.906150] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.906150] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.906915] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.119938] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.120208] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.120375] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.121745] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.125296] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.125416] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.125493] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.125690] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.125778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.125872] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.126050] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.128041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.128041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.128041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.128041] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.128041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.128041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.128041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.128041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.128041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.128041] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.161504] env[69920]: INFO networking_nsxv3.common.synchronization [req-fd9cd17d-3a27-44e3-8b8c-e3f901829dcd req-85aa311d-9900-421b-b0c0-b2d75dbd690c tempest-AttachVolumeShelveTestJSON-389172843 tempest-AttachVolumeShelveTestJSON-389172843-project-member] Enqueued Resource ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf with Priority: HIGHEST for action security_group_members [ 870.163053] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf with Priority: HIGHEST for action security_group_members [ 870.163053] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.163053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.163053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.163053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.163470] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.163470] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.163912] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.163912] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.163912] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.164206] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.252414] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.252414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.252414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.252414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.252414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.252414] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 is going to be created. [ 870.280360] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.280360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.280360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.280360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.280360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.289497] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: UNINITIALIZED for 2s [ 870.410564] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.411884] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.412026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.412487] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.435752] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.436126] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.436322] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.436411] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.436645] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.436771] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.436870] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 is going to be updated. [ 870.472318] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.472966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.472966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.472966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.472966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.487789] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: IN_PROGRESS for 2s [ 870.630375] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fdaff9b-63be-497c-8622-3160e739856a: rpc.has_security_group_logging(os_id): False [ 870.653834] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.653834] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.654077] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.654647] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.654827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.655066] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.655236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.655300] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.655816] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.655816] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.655816] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.655816] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.656342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.656342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.659682] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.659911] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.660028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.660099] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.660265] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.660358] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.660453] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be created. [ 870.668594] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.672019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.672019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.672019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.672019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.672019] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.672019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.672019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.672019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.672019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.672019] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf already deleted. [ 870.672019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.692136] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-436 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.692365] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-436" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.692499] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-436" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.692817] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-436" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.693111] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.693312] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.693515] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.693802] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.693950] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.694176] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 870.694294] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 870.694406] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 870.694515] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 870.694627] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 870.694734] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 870.694869] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 870.717628] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 870.717941] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 870.718096] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 870.718495] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-436" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.718926] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-699de5cd-28f8-453d-8f0a-7856f2d6a2b0 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.719222] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-699de5cd-28f8-453d-8f0a-7856f2d6a2b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.719418] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-699de5cd-28f8-453d-8f0a-7856f2d6a2b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.719979] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-699de5cd-28f8-453d-8f0a-7856f2d6a2b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.720093] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('699de5cd-28f8-453d-8f0a-7856f2d6a2b0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.723068] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.723231] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.723311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.723714] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.723861] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.739475] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: IN_PROGRESS for 2s [ 871.224197] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.224197] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.224197] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.224197] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.224197] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.224716] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 699de5cd-28f8-453d-8f0a-7856f2d6a2b0 not found, creating... [ 871.224716] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.224892] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.225529] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.225529] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.225529] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.225842] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.226020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.226259] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.230300] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.230300] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.230300] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 699de5cd-28f8-453d-8f0a-7856f2d6a2b0 is going to be created. [ 871.256748] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.256973] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.257109] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.257381] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.257626] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.257853] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-699de5cd-28f8-453d-8f0a-7856f2d6a2b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.122977] env[69920]: INFO networking_nsxv3.common.synchronization [req-fd9cd17d-3a27-44e3-8b8c-e3f901829dcd req-9b3a1113-b112-46b0-b135-d72eab60ece4 service nova] Enqueued Resource ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf with Priority: HIGHEST for action security_group_rules [ 872.123066] env[69920]: INFO networking_nsxv3.common.synchronization [req-fd9cd17d-3a27-44e3-8b8c-e3f901829dcd req-9b3a1113-b112-46b0-b135-d72eab60ece4 service nova] Enqueued Resource ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf with Priority: HIGHEST for action security_group_members [ 872.123233] env[69920]: INFO networking_nsxv3.common.synchronization [req-fd9cd17d-3a27-44e3-8b8c-e3f901829dcd req-9b3a1113-b112-46b0-b135-d72eab60ece4 service nova] Enqueued Resource ID: 699de5cd-28f8-453d-8f0a-7856f2d6a2b0 with Priority: HIGHEST for action port [ 872.125081] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf with Priority: HIGHEST for action security_group_rules [ 872.125081] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf with Priority: HIGHEST for action security_group_members [ 872.125081] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 699de5cd-28f8-453d-8f0a-7856f2d6a2b0 with Priority: HIGHEST for action port [ 872.125081] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.125081] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.125081] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.125081] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.125081] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.126652] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.126652] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.126652] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.126652] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.126652] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.126652] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.126652] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.126652] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.126652] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.127122] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.127529] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-699de5cd-28f8-453d-8f0a-7856f2d6a2b0 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.127634] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-699de5cd-28f8-453d-8f0a-7856f2d6a2b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.127700] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-699de5cd-28f8-453d-8f0a-7856f2d6a2b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.127855] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-699de5cd-28f8-453d-8f0a-7856f2d6a2b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.127925] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('699de5cd-28f8-453d-8f0a-7856f2d6a2b0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.301510] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: SUCCESS [ 872.301510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.301510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.301510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.301510] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.301510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.301510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.301510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.301510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.301510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.301510] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.498108] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: SUCCESS [ 872.498283] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 deletion is rescheduled due to dependency. [ 872.498400] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.629521] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.630687] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.630865] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.630955] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 699de5cd-28f8-453d-8f0a-7856f2d6a2b0 with status ACTIVE [ 872.631135] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.631236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.631303] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.631517] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.631629] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.631771] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.631868] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.631930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.632093] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.632170] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.634467] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.634659] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.634728] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.634895] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.634977] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.635084] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 699de5cd-28f8-453d-8f0a-7856f2d6a2b0 is going to be updated. [ 872.659731] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.659917] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.659979] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.660211] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.660390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.660833] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-699de5cd-28f8-453d-8f0a-7856f2d6a2b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.777138] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: SUCCESS [ 872.777318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.804149] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.804388] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.804388] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.804561] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.804733] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.804834] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.804899] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.805449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.805449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.805449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.805801] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.805801] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.805930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.807058] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.807058] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.807058] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.807058] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.807058] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.807058] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.807058] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.807461] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.137605] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.312537] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7eba410e-a0d6-4873-9363-054f457d21d4: rpc.has_security_group_logging(os_id): False [ 873.333802] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.333989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.334047] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.334263] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.334360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.334738] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.334851] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.334952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.335311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.335386] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.335623] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.335730] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.335836] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.335999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.337211] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.337441] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.337553] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.337619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.337792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.337872] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.337964] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 is going to be created. [ 873.445937] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.446113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.446169] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.448162] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.448162] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.483157] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: IN_PROGRESS for 2s [ 873.642910] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.643130] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.643205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.643426] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.643516] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.643617] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf is going to be created. [ 873.672728] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.673452] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.673452] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.673452] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.673452] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.684494] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf in Status: UNINITIALIZED for 2s [ 875.497035] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: SUCCESS [ 875.497430] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.702707] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf in Status: SUCCESS [ 875.702948] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.703177] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.703422] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.703613] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.703728] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.703797] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.703994] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.704172] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.704325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.704449] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.206763] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.710362] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf: rpc.has_security_group_logging(os_id): False [ 876.736307] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.736542] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.736656] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.736960] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.737112] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.737468] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.737638] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.737701] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.737951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.738183] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.738310] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf is going to be created. [ 876.828028] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.828028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.828028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.828028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.828028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.842920] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf in Status: IN_PROGRESS for 2s [ 876.901200] env[69920]: INFO networking_nsxv3.common.synchronization [req-d6684c6d-dca5-4b3b-9fd6-2d7f5d8de85b req-3d4fde78-5cb5-4b6f-844a-3bef590e812f tempest-ServersTestMultiNic-1807665099 tempest-ServersTestMultiNic-1807665099-project-member] Enqueued Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 876.901200] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 876.901200] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.901200] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.901200] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.901842] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.902154] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.902413] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.902573] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.902959] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.903176] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.903369] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.408037] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.408037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.408037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.408037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.408037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.408037] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.408037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.408037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.408037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.408037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.408037] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 already deleted. [ 877.408037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.470161] env[69920]: INFO networking_nsxv3.common.synchronization [req-d6684c6d-dca5-4b3b-9fd6-2d7f5d8de85b req-6fff4502-57a2-4dae-99d2-8fa28d4e17be tempest-ServersTestMultiNic-1807665099 tempest-ServersTestMultiNic-1807665099-project-member] Enqueued Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 877.470161] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 877.470161] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.470161] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.470161] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.470161] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.470161] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.470161] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.470161] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.470161] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.470161] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.470776] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.972731] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.973048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.973048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.973267] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.973366] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.973564] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.973874] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.974059] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.974210] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.974260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.974321] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 already deleted. [ 877.974402] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.096096] env[69920]: INFO networking_nsxv3.common.synchronization [req-d6684c6d-dca5-4b3b-9fd6-2d7f5d8de85b req-2e17603a-0f3c-431c-9e85-ce75f2fb9b1f tempest-ServersTestMultiNic-1807665099 tempest-ServersTestMultiNic-1807665099-project-member] Enqueued Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 878.100143] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 878.100767] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.100903] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.100972] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.101202] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.101380] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.101489] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.101556] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.101707] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.101814] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.101916] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.607581] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.608975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.609397] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.610301] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.610301] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.610301] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.610301] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.610301] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.610556] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.610753] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.610753] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 already deleted. [ 878.610856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.627887] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-54 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.628193] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-54" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.628369] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-54" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.628808] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-54" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.629078] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.629264] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.629434] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.629715] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.629872] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.630109] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 878.630240] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 878.630448] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 878.630538] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 878.630692] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 878.630835] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 878.631093] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 878.656597] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 878.656948] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 878.657180] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 878.657547] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-54" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.657948] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-fa4af0b2-0db2-4cb8-bfd1-8a09dc8c41d1 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.658258] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-fa4af0b2-0db2-4cb8-bfd1-8a09dc8c41d1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.658416] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-fa4af0b2-0db2-4cb8-bfd1-8a09dc8c41d1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.658865] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-fa4af0b2-0db2-4cb8-bfd1-8a09dc8c41d1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.659245] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa4af0b2-0db2-4cb8-bfd1-8a09dc8c41d1',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.855768] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf in Status: SUCCESS [ 878.855998] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.165070] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.165583] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.166303] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.166303] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.166765] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.166765] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port fa4af0b2-0db2-4cb8-bfd1-8a09dc8c41d1 not found, creating... [ 879.167072] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.167416] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.167606] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.167995] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.168169] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.168581] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.168801] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.169076] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.169180] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.169321] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.169472] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: fa4af0b2-0db2-4cb8-bfd1-8a09dc8c41d1 is going to be created. [ 879.192864] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.192864] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.192864] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.193133] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.193448] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.193786] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-fa4af0b2-0db2-4cb8-bfd1-8a09dc8c41d1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.006212] env[69920]: INFO networking_nsxv3.common.synchronization [req-d6684c6d-dca5-4b3b-9fd6-2d7f5d8de85b req-31c04b32-f083-4a37-a4dc-9222ba7ae4c2 service nova] Enqueued Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_rules [ 880.006361] env[69920]: INFO networking_nsxv3.common.synchronization [req-d6684c6d-dca5-4b3b-9fd6-2d7f5d8de85b req-31c04b32-f083-4a37-a4dc-9222ba7ae4c2 service nova] Enqueued Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 880.006507] env[69920]: INFO networking_nsxv3.common.synchronization [req-d6684c6d-dca5-4b3b-9fd6-2d7f5d8de85b req-31c04b32-f083-4a37-a4dc-9222ba7ae4c2 service nova] Enqueued Resource ID: fa4af0b2-0db2-4cb8-bfd1-8a09dc8c41d1 with Priority: HIGHEST for action port [ 880.007044] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_rules [ 880.007186] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 880.007280] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa4af0b2-0db2-4cb8-bfd1-8a09dc8c41d1 with Priority: HIGHEST for action port [ 880.007560] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.007684] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.007753] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.008030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.008116] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.009181] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.009181] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.009181] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.009326] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.009691] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.009691] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.009691] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.009691] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.009887] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.009887] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.010638] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa4af0b2-0db2-4cb8-bfd1-8a09dc8c41d1 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.010738] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa4af0b2-0db2-4cb8-bfd1-8a09dc8c41d1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.010808] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa4af0b2-0db2-4cb8-bfd1-8a09dc8c41d1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.010960] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa4af0b2-0db2-4cb8-bfd1-8a09dc8c41d1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.011086] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa4af0b2-0db2-4cb8-bfd1-8a09dc8c41d1',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.513046] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.514220] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.514399] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.516039] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa4af0b2-0db2-4cb8-bfd1-8a09dc8c41d1 with status ACTIVE [ 880.516266] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.516438] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.516518] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.516722] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.516813] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.516987] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.517169] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.517169] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.517324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.517407] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.517609] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.517712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.517776] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.517920] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.517996] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.518095] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa4af0b2-0db2-4cb8-bfd1-8a09dc8c41d1 is going to be updated. [ 880.544183] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.544424] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.544522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.544740] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.544879] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.545060] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa4af0b2-0db2-4cb8-bfd1-8a09dc8c41d1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.878957] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.879205] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-913" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.879339] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-913" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.879702] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-913" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.880897] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.881170] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.881346] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.881648] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.881840] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.882167] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 880.882281] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 880.882429] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 880.882569] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 880.882733] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 880.882968] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 880.883184] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 880.904198] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 880.904435] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 880.905031] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 880.905031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-913" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.905493] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-b0d2f460-225f-47fe-96d1-bdefd018eac5 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.905745] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-b0d2f460-225f-47fe-96d1-bdefd018eac5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.905970] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-b0d2f460-225f-47fe-96d1-bdefd018eac5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.906434] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-b0d2f460-225f-47fe-96d1-bdefd018eac5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.906624] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0d2f460-225f-47fe-96d1-bdefd018eac5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.983535] env[69920]: INFO networking_nsxv3.common.synchronization [req-be56dda3-46ac-498b-8391-fc1dfdfbee89 req-4fe2ab26-dd0f-4964-ab5b-8133aba289b4 tempest-ServerRescueTestJSON-1075581336 tempest-ServerRescueTestJSON-1075581336-project-member] Enqueued Resource ID: a6054485-180a-4f29-a65a-3151187db51e with Priority: HIGHEST for action security_group_members [ 880.983535] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6054485-180a-4f29-a65a-3151187db51e with Priority: HIGHEST for action security_group_members [ 880.983767] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6054485-180a-4f29-a65a-3151187db51e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.983956] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.984378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.984647] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.984846] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.985651] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.985651] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.985651] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.985651] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.985651] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6054485-180a-4f29-a65a-3151187db51e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.016371] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.409671] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.410040] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.410113] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.410684] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.410684] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.410684] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port b0d2f460-225f-47fe-96d1-bdefd018eac5 not found, creating... [ 881.410996] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.411231] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.411282] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.411824] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.411824] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.412090] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.412090] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.412218] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.413029] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.413029] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.413029] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: b0d2f460-225f-47fe-96d1-bdefd018eac5 is going to be created. [ 881.433947] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.434265] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.434440] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.434612] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.434806] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.435048] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-b0d2f460-225f-47fe-96d1-bdefd018eac5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.490770] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6054485-180a-4f29-a65a-3151187db51e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.519937] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.519937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.519937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.520256] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.520256] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.520256] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 is going to be created. [ 881.558364] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.558582] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.558582] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.558780] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.558944] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.572990] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: UNINITIALIZED for 2s [ 882.000280] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6054485-180a-4f29-a65a-3151187db51e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.505628] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.505783] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.505851] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.506110] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.506204] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.506396] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6054485-180a-4f29-a65a-3151187db51e is going to be updated. [ 882.535619] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.535953] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.535953] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.536181] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.536322] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.545140] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6054485-180a-4f29-a65a-3151187db51e in Status: IN_PROGRESS for 2s [ 883.037672] env[69920]: INFO networking_nsxv3.common.synchronization [req-d6684c6d-dca5-4b3b-9fd6-2d7f5d8de85b req-77e4ac69-e7e1-4f31-ba37-82c2f49fa882 service nova] Enqueued Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_rules [ 883.037672] env[69920]: INFO networking_nsxv3.common.synchronization [req-d6684c6d-dca5-4b3b-9fd6-2d7f5d8de85b req-77e4ac69-e7e1-4f31-ba37-82c2f49fa882 service nova] Enqueued Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 883.037672] env[69920]: INFO networking_nsxv3.common.synchronization [req-d6684c6d-dca5-4b3b-9fd6-2d7f5d8de85b req-77e4ac69-e7e1-4f31-ba37-82c2f49fa882 service nova] Enqueued Resource ID: b0d2f460-225f-47fe-96d1-bdefd018eac5 with Priority: HIGHEST for action port [ 883.037672] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_rules [ 883.037672] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 883.037672] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0d2f460-225f-47fe-96d1-bdefd018eac5 with Priority: HIGHEST for action port [ 883.037672] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.038211] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.038211] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.038211] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.038211] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0d2f460-225f-47fe-96d1-bdefd018eac5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.038492] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0d2f460-225f-47fe-96d1-bdefd018eac5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.038492] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0d2f460-225f-47fe-96d1-bdefd018eac5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.038586] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0d2f460-225f-47fe-96d1-bdefd018eac5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.038622] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0d2f460-225f-47fe-96d1-bdefd018eac5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.544440] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0d2f460-225f-47fe-96d1-bdefd018eac5 with status ACTIVE [ 883.547074] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.547074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.547074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.547074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.547074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.547074] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.547074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.547074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.547074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.547074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.547074] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.547074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.547074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.547074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.547074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.547074] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0d2f460-225f-47fe-96d1-bdefd018eac5 is going to be updated. [ 883.570710] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.570710] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.570710] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.570710] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.570710] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.570710] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0d2f460-225f-47fe-96d1-bdefd018eac5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.584022] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: SUCCESS [ 883.584423] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.584696] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.585128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.585368] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.585500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.585570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.585753] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.585837] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.585926] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.586038] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.586951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.588122] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.588122] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.588122] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.588122] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.588122] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.588122] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.588122] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.030062] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-54 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.031038] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-54" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.034837] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-54" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.034837] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-54" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.034837] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.034837] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.034837] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.035109] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.036024] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.036024] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 884.036024] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 884.036024] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 884.036200] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 884.036200] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 884.036285] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 884.036428] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 884.059279] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 884.059554] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 884.059716] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 884.059897] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-54" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.060230] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-e789eded-c761-41d1-90f9-0541da7d7635 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.060541] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-e789eded-c761-41d1-90f9-0541da7d7635" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.060582] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-e789eded-c761-41d1-90f9-0541da7d7635" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.060960] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-e789eded-c761-41d1-90f9-0541da7d7635" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.063513] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e789eded-c761-41d1-90f9-0541da7d7635',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.089675] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.089814] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.090170] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.269424] env[69920]: INFO networking_nsxv3.common.synchronization [req-9b983aff-02fb-45a9-bd9c-9f9041868654 req-58674436-7c57-40b5-8c60-b464422b6a60 tempest-FloatingIPsAssociationTestJSON-1358918757 tempest-FloatingIPsAssociationTestJSON-1358918757-project-member] Enqueued Resource ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd with Priority: HIGHEST for action security_group_members [ 884.270507] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd with Priority: HIGHEST for action security_group_members [ 884.270830] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-40f3bd9f-8637-49e8-92cd-03812c846cfd taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.270948] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.271023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.271226] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.271862] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.271862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.271862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.272036] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.272081] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.272281] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.556488] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6054485-180a-4f29-a65a-3151187db51e in Status: SUCCESS [ 884.556836] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.567552] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.567552] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.567552] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.568636] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.568636] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.568636] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port e789eded-c761-41d1-90f9-0541da7d7635 not found, creating... [ 884.568636] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.568882] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.569026] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.569341] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.569497] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.569848] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.570040] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.570286] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.570565] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.570734] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.570910] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: e789eded-c761-41d1-90f9-0541da7d7635 is going to be created. [ 884.589656] env[69920]: INFO networking_nsxv3.common.synchronization [req-56cbae79-9c23-4f9c-b322-2d5669c60ebb req-5c2094c3-6fef-45c1-80ee-d0f97e016567 tempest-ServerMetadataTestJSON-1221837469 tempest-ServerMetadataTestJSON-1221837469-project-member] Enqueued Resource ID: b1a5abeb-ac32-4d23-a23f-c0ae308abad8 with Priority: HIGHEST for action security_group_members [ 884.589897] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a5abeb-ac32-4d23-a23f-c0ae308abad8 with Priority: HIGHEST for action security_group_members [ 884.590206] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.590330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.590404] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.590656] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.590806] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.590902] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.590963] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.591130] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.591210] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.591301] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a5abeb-ac32-4d23-a23f-c0ae308abad8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.592342] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.597010] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.597442] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.597442] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.597599] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.597832] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.598175] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-e789eded-c761-41d1-90f9-0541da7d7635" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.775517] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.775696] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.775766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.776019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.776118] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.776445] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.776583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.776641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.776793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.776870] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.776975] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd is going to be updated. [ 884.816805] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.817014] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.817137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.817425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.817595] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.830160] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd in Status: IN_PROGRESS for 2s [ 885.095537] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.095775] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.095839] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.096442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.096442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.096442] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.096442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.096874] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.096874] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.096874] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.096874] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a5abeb-ac32-4d23-a23f-c0ae308abad8 already deleted. [ 885.096874] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.097335] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.097335] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.097429] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.097584] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.097647] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.097721] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 is going to be updated. [ 885.141640] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.141831] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.141887] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.147859] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.147859] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.157926] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: IN_PROGRESS for 2s [ 885.261356] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-958 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.261545] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-958" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.261829] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-958" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.263326] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-958" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.263689] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.263876] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.264013] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.264290] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.264446] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.264667] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.264786] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.264901] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.265027] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.265151] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 885.265262] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.265421] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.283326] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.283600] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 885.283783] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.284012] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-958" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.284373] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-0a7e52ca-6c1d-456c-a839-ce5f626c210d taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.284557] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-0a7e52ca-6c1d-456c-a839-ce5f626c210d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.284682] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-0a7e52ca-6c1d-456c-a839-ce5f626c210d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.285014] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-0a7e52ca-6c1d-456c-a839-ce5f626c210d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.285172] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a7e52ca-6c1d-456c-a839-ce5f626c210d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.663358] env[69920]: INFO networking_nsxv3.common.synchronization [req-d6684c6d-dca5-4b3b-9fd6-2d7f5d8de85b req-ad88e69f-a151-4d3b-95de-619cb7024203 service nova] Enqueued Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_rules [ 885.663358] env[69920]: INFO networking_nsxv3.common.synchronization [req-d6684c6d-dca5-4b3b-9fd6-2d7f5d8de85b req-ad88e69f-a151-4d3b-95de-619cb7024203 service nova] Enqueued Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 885.663358] env[69920]: INFO networking_nsxv3.common.synchronization [req-d6684c6d-dca5-4b3b-9fd6-2d7f5d8de85b req-ad88e69f-a151-4d3b-95de-619cb7024203 service nova] Enqueued Resource ID: e789eded-c761-41d1-90f9-0541da7d7635 with Priority: HIGHEST for action port [ 885.663358] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_rules [ 885.663358] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 885.663358] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e789eded-c761-41d1-90f9-0541da7d7635 with Priority: HIGHEST for action port [ 885.663358] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.663358] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.663358] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.663358] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.664011] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-e789eded-c761-41d1-90f9-0541da7d7635 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.665013] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e789eded-c761-41d1-90f9-0541da7d7635" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.665115] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e789eded-c761-41d1-90f9-0541da7d7635" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.665385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e789eded-c761-41d1-90f9-0541da7d7635" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.665469] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e789eded-c761-41d1-90f9-0541da7d7635',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.787415] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.787519] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.787679] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.787959] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.788129] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.788291] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 0a7e52ca-6c1d-456c-a839-ce5f626c210d not found, creating... [ 885.788889] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.789210] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.789433] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.790179] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.790564] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.791797] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.794462] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.794462] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.794462] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.794462] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.794462] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 0a7e52ca-6c1d-456c-a839-ce5f626c210d is going to be created. [ 885.814378] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.814671] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.814778] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.815070] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.815326] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.815563] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-0a7e52ca-6c1d-456c-a839-ce5f626c210d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.172348] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e789eded-c761-41d1-90f9-0541da7d7635 with status ACTIVE [ 886.172601] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.172745] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.172814] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.173049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.173210] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.173413] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.173524] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.173584] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.173744] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.173824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.174014] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.174110] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.174171] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.174313] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.174388] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.174491] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e789eded-c761-41d1-90f9-0541da7d7635 is going to be updated. [ 886.223232] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.223444] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.223511] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.223719] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.223857] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.224024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e789eded-c761-41d1-90f9-0541da7d7635" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.845342] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd in Status: SUCCESS [ 886.845342] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd deletion is rescheduled due to dependency. [ 886.845342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.048966] env[69920]: INFO networking_nsxv3.common.synchronization [req-56cbae79-9c23-4f9c-b322-2d5669c60ebb req-82e7d8ef-60b4-4d5b-9b23-0ad9539f190c service nova] Enqueued Resource ID: b1a5abeb-ac32-4d23-a23f-c0ae308abad8 with Priority: HIGHEST for action security_group_rules [ 887.049169] env[69920]: INFO networking_nsxv3.common.synchronization [req-56cbae79-9c23-4f9c-b322-2d5669c60ebb req-82e7d8ef-60b4-4d5b-9b23-0ad9539f190c service nova] Enqueued Resource ID: b1a5abeb-ac32-4d23-a23f-c0ae308abad8 with Priority: HIGHEST for action security_group_members [ 887.049356] env[69920]: INFO networking_nsxv3.common.synchronization [req-56cbae79-9c23-4f9c-b322-2d5669c60ebb req-82e7d8ef-60b4-4d5b-9b23-0ad9539f190c service nova] Enqueued Resource ID: 0a7e52ca-6c1d-456c-a839-ce5f626c210d with Priority: HIGHEST for action port [ 887.049614] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a5abeb-ac32-4d23-a23f-c0ae308abad8 with Priority: HIGHEST for action security_group_rules [ 887.049828] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a5abeb-ac32-4d23-a23f-c0ae308abad8 with Priority: HIGHEST for action security_group_members [ 887.050100] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7e52ca-6c1d-456c-a839-ce5f626c210d with Priority: HIGHEST for action port [ 887.052309] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1a5abeb-ac32-4d23-a23f-c0ae308abad8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.052309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.052309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.052606] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.052606] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1a5abeb-ac32-4d23-a23f-c0ae308abad8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.054659] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.054659] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.054659] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.054659] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.054659] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.054659] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.054659] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.054659] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.054659] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.055069] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a5abeb-ac32-4d23-a23f-c0ae308abad8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.061199] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a7e52ca-6c1d-456c-a839-ce5f626c210d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.061199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a7e52ca-6c1d-456c-a839-ce5f626c210d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.061199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a7e52ca-6c1d-456c-a839-ce5f626c210d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.061199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a7e52ca-6c1d-456c-a839-ce5f626c210d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.061199] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a7e52ca-6c1d-456c-a839-ce5f626c210d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.176907] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: SUCCESS [ 887.177157] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.177337] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.177567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.177760] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.177881] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.177946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.178133] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.178579] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.178686] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.178851] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.178925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.179120] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.179349] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.179518] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.179617] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.179683] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.179830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.179907] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.179990] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.180095] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.181319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.181464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.181622] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.181720] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.181781] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.181926] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.182010] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.182349] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.557722] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1a5abeb-ac32-4d23-a23f-c0ae308abad8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.558818] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.558922] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.561903] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a7e52ca-6c1d-456c-a839-ce5f626c210d with status ACTIVE [ 887.562156] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.562271] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.562320] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.562494] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.562664] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.562742] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.562840] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.562902] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.563412] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.563587] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.563970] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.563970] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.564150] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.564336] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.564768] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.564958] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a7e52ca-6c1d-456c-a839-ce5f626c210d is going to be updated. [ 887.598025] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.598025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.598025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.598025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.598025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.598025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a7e52ca-6c1d-456c-a839-ce5f626c210d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.613726] env[69920]: INFO networking_nsxv3.common.synchronization [req-fab1d314-b435-4f4b-b80a-e85414f29af8 req-cada1a71-6f90-4258-b1f8-98cec90b117c tempest-VolumesAdminNegativeTest-1491739297 tempest-VolumesAdminNegativeTest-1491739297-project-member] Enqueued Resource ID: a7b62144-a34e-4e44-9dda-a1306bb3fa05 with Priority: HIGHEST for action security_group_members [ 887.615262] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7b62144-a34e-4e44-9dda-a1306bb3fa05 with Priority: HIGHEST for action security_group_members [ 887.615262] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7b62144-a34e-4e44-9dda-a1306bb3fa05 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.615262] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.615262] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.616231] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.616463] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.616588] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.616869] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.616869] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.617747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.617747] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7b62144-a34e-4e44-9dda-a1306bb3fa05',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.684262] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7aae69a5-1701-43e9-9978-86df7a832270: rpc.has_security_group_logging(os_id): False [ 887.685533] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.711636] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.711822] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.711861] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.712087] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.712192] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.712381] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.712485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.712548] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.712719] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.712798] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.712980] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.713092] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.713157] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.713321] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.713400] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.713654] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.713780] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.713846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.714013] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.714485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.714586] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 is going to be created. [ 887.788329] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.788498] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.788582] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.788812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.789033] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.808670] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: IN_PROGRESS for 2s [ 888.062364] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1a5abeb-ac32-4d23-a23f-c0ae308abad8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.120033] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.120198] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.120272] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.120498] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.120591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.120796] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.120887] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.121020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.121116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.121192] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.121276] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7b62144-a34e-4e44-9dda-a1306bb3fa05 already deleted. [ 888.121371] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.189490] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.568283] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.568446] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.568516] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.568919] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.568919] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.568919] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a5abeb-ac32-4d23-a23f-c0ae308abad8 is going to be created. [ 888.594779] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.594779] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.594779] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.594779] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.594779] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.607741] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a5abeb-ac32-4d23-a23f-c0ae308abad8 in Status: UNINITIALIZED for 2s [ 888.691697] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.692018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.692112] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.692386] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.692544] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.692684] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 is going to be updated. [ 888.737828] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.737976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.738059] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.738285] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.738449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.749757] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: IN_PROGRESS for 2s [ 888.813915] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-614 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.814152] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-614" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.814278] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-614" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.814558] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-614" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.814820] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.815020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.815204] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.815548] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.815963] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.815963] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 888.816083] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 888.816194] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 888.816321] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 888.816443] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 888.816576] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 888.816725] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 888.838907] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 888.839229] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 888.839349] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 888.839455] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-614" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.839818] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-703aee39-6cbb-4cc4-8043-e405ac713dda taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.840020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-703aee39-6cbb-4cc4-8043-e405ac713dda" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.840161] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-703aee39-6cbb-4cc4-8043-e405ac713dda" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.840562] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-703aee39-6cbb-4cc4-8043-e405ac713dda" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.840692] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('703aee39-6cbb-4cc4-8043-e405ac713dda',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.347095] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.347614] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.347614] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.348975] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.348975] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.348975] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 703aee39-6cbb-4cc4-8043-e405ac713dda not found, creating... [ 889.348975] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.348975] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.348975] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.349227] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.351836] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.352996] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.353297] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.353526] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.353874] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.354135] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.354233] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 703aee39-6cbb-4cc4-8043-e405ac713dda is going to be created. [ 889.377230] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.378058] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.378211] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.378562] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.378855] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.379126] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-703aee39-6cbb-4cc4-8043-e405ac713dda" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.610158] env[69920]: INFO networking_nsxv3.common.synchronization [req-a0693cd8-1db0-4382-b1a9-a29ee2429633 req-93226afe-7add-4285-8482-d49f58142b7f tempest-DeleteServersTestJSON-1690074738 tempest-DeleteServersTestJSON-1690074738-project-member] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 889.610799] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 889.611197] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.611329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.611403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.611615] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.611770] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.611877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.611936] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.612160] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.612204] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.612293] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.821581] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: SUCCESS [ 889.821804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.821982] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.822220] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.825057] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.115204] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.115430] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.115485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.115678] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.115774] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.115977] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.116093] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.116151] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.116308] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.116393] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.116483] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be updated. [ 890.151350] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.151520] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.151788] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.151957] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.152128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.161119] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: IN_PROGRESS for 2s [ 890.327972] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.328927] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.387754] env[69920]: INFO networking_nsxv3.common.synchronization [req-0020d687-e9e7-4fee-9b10-72bdc0456f45 req-07ab1dc9-7294-4a5f-a70a-d4dac8a5d57e tempest-ServersAdminTestJSON-859816448 tempest-ServersAdminTestJSON-859816448-project-member] Enqueued Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 890.387754] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 890.388345] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.388575] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.388575] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.388795] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.388948] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.389060] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.389124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.389274] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.389367] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.389520] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.471560] env[69920]: INFO networking_nsxv3.common.synchronization [req-fab1d314-b435-4f4b-b80a-e85414f29af8 req-ab9374ab-1d09-45eb-86b9-b01768806f7d service nova] Enqueued Resource ID: a7b62144-a34e-4e44-9dda-a1306bb3fa05 with Priority: HIGHEST for action security_group_rules [ 890.471974] env[69920]: INFO networking_nsxv3.common.synchronization [req-fab1d314-b435-4f4b-b80a-e85414f29af8 req-ab9374ab-1d09-45eb-86b9-b01768806f7d service nova] Enqueued Resource ID: a7b62144-a34e-4e44-9dda-a1306bb3fa05 with Priority: HIGHEST for action security_group_members [ 890.471974] env[69920]: INFO networking_nsxv3.common.synchronization [req-fab1d314-b435-4f4b-b80a-e85414f29af8 req-ab9374ab-1d09-45eb-86b9-b01768806f7d service nova] Enqueued Resource ID: 703aee39-6cbb-4cc4-8043-e405ac713dda with Priority: HIGHEST for action port [ 890.472508] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7b62144-a34e-4e44-9dda-a1306bb3fa05 with Priority: HIGHEST for action security_group_rules [ 890.472683] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7b62144-a34e-4e44-9dda-a1306bb3fa05 with Priority: HIGHEST for action security_group_members [ 890.475863] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 703aee39-6cbb-4cc4-8043-e405ac713dda with Priority: HIGHEST for action port [ 890.475863] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7b62144-a34e-4e44-9dda-a1306bb3fa05 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.475863] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.475863] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.475863] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.475863] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7b62144-a34e-4e44-9dda-a1306bb3fa05',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.475863] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7b62144-a34e-4e44-9dda-a1306bb3fa05 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.475863] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.475863] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.475863] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.475863] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.475863] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.475863] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.475863] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.475863] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.475863] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7b62144-a34e-4e44-9dda-a1306bb3fa05',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.476719] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-703aee39-6cbb-4cc4-8043-e405ac713dda taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.476719] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-703aee39-6cbb-4cc4-8043-e405ac713dda" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.476719] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-703aee39-6cbb-4cc4-8043-e405ac713dda" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.476719] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-703aee39-6cbb-4cc4-8043-e405ac713dda" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.476719] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('703aee39-6cbb-4cc4-8043-e405ac713dda',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.621212] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a5abeb-ac32-4d23-a23f-c0ae308abad8 in Status: SUCCESS [ 890.621518] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.621682] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.621877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.622083] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.622208] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.622285] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.622519] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.622571] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.622652] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.622744] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1a5abeb-ac32-4d23-a23f-c0ae308abad8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.759724] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: SUCCESS [ 890.760389] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.760389] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.760389] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.760556] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.760784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.760784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.760919] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.760919] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.760985] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.761149] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.892365] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.978975] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7b62144-a34e-4e44-9dda-a1306bb3fa05 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.979176] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.979352] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7b62144-a34e-4e44-9dda-a1306bb3fa05',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.980353] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 703aee39-6cbb-4cc4-8043-e405ac713dda with status ACTIVE [ 890.980581] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.980702] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.980773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.980983] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.984016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.984016] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.984016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.984016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.984016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.984016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.984016] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.984016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.984016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.984016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.984016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.984016] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 703aee39-6cbb-4cc4-8043-e405ac713dda is going to be updated. [ 891.015397] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.015397] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.015397] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.015717] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.015771] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.015961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-703aee39-6cbb-4cc4-8043-e405ac713dda" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.125979] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.126638] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.126981] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.127450] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.127831] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.128103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.128289] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.128627] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.130026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.130026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.130026] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.130026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.130026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.130026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.130026] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.130622] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.130876] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.131212] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.131458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.131847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.132844] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1a5abeb-ac32-4d23-a23f-c0ae308abad8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.236172] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-613 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.236695] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-613" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.236695] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-613" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.236968] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-613" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.240245] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.240682] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.240873] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.241027] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.241233] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.241551] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 891.241717] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 891.241848] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 891.241994] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 891.242139] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 891.242256] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 891.242414] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 891.266404] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.268812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.268812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.268812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.268812] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.268812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.268812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.268812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.268812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.268812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.268812] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.268812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.268812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.268812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.268812] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.268812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.268812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.269487] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.269487] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.269487] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.269487] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.276755] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 891.277343] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 891.277617] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 891.277962] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-613" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.278500] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-4b7f5764-23c4-40f8-a618-0c608e0e987d taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.278899] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-4b7f5764-23c4-40f8-a618-0c608e0e987d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.279092] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-4b7f5764-23c4-40f8-a618-0c608e0e987d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.279629] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-4b7f5764-23c4-40f8-a618-0c608e0e987d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.279841] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b7f5764-23c4-40f8-a618-0c608e0e987d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.394740] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.486439] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7b62144-a34e-4e44-9dda-a1306bb3fa05',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.636896] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1a5abeb-ac32-4d23-a23f-c0ae308abad8: rpc.has_security_group_logging(os_id): False [ 891.660114] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.660281] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.660356] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.660935] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.660935] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.661093] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.661093] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.661198] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.661367] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.661402] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.661667] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.661667] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.661822] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.661822] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.661893] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.662421] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.662582] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.662893] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.663089] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.663211] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.663450] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1a5abeb-ac32-4d23-a23f-c0ae308abad8 is going to be created. [ 891.730352] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.730595] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.730717] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.731069] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.731380] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.749229] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1a5abeb-ac32-4d23-a23f-c0ae308abad8 in Status: IN_PROGRESS for 2s [ 891.772088] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7aae69a5-1701-43e9-9978-86df7a832270: rpc.has_security_group_logging(os_id): False [ 891.784909] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.784909] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.784909] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.784909] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.784909] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.784909] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 4b7f5764-23c4-40f8-a618-0c608e0e987d not found, creating... [ 891.784909] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.784909] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.785274] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.785345] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.785527] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.785854] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.786974] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.791123] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.791488] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.791692] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.791931] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 4b7f5764-23c4-40f8-a618-0c608e0e987d is going to be created. [ 891.793972] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.794263] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.794332] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.794536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.794631] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.794831] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.794934] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.795018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.795189] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.795272] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.795545] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.796189] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.796189] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.796189] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.796189] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.796385] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.796385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.796385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.796571] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.796632] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.796724] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 is going to be updated. [ 891.824962] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.825207] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.825369] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.825683] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.825919] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.826165] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-4b7f5764-23c4-40f8-a618-0c608e0e987d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.899925] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.899925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.899925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.899925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.899925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.899925] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a is going to be updated. [ 891.902163] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.902317] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.902390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.902578] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.902722] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.928412] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: IN_PROGRESS for 2s [ 891.947247] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.947247] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.947247] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.947247] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.947247] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.961202] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: IN_PROGRESS for 2s [ 891.992160] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.992160] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.992160] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.992160] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.992160] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.992160] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7b62144-a34e-4e44-9dda-a1306bb3fa05 is going to be created. [ 892.042825] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.042981] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.043065] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.043453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.043625] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.055068] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7b62144-a34e-4e44-9dda-a1306bb3fa05 in Status: UNINITIALIZED for 2s [ 892.178518] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: SUCCESS [ 892.178705] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a deletion is rescheduled due to dependency. [ 892.178821] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.777036] env[69920]: INFO networking_nsxv3.common.synchronization [req-0020d687-e9e7-4fee-9b10-72bdc0456f45 req-31f71e9c-c9aa-4a46-a82d-616bfdab6940 service nova] Enqueued Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_rules [ 892.777317] env[69920]: INFO networking_nsxv3.common.synchronization [req-0020d687-e9e7-4fee-9b10-72bdc0456f45 req-31f71e9c-c9aa-4a46-a82d-616bfdab6940 service nova] Enqueued Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 892.777368] env[69920]: INFO networking_nsxv3.common.synchronization [req-0020d687-e9e7-4fee-9b10-72bdc0456f45 req-31f71e9c-c9aa-4a46-a82d-616bfdab6940 service nova] Enqueued Resource ID: 4b7f5764-23c4-40f8-a618-0c608e0e987d with Priority: HIGHEST for action port [ 892.779305] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_rules [ 892.779470] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 892.779646] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b7f5764-23c4-40f8-a618-0c608e0e987d with Priority: HIGHEST for action port [ 892.779988] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.780135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.780208] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.780452] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.780544] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.781538] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.781641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.781857] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b7f5764-23c4-40f8-a618-0c608e0e987d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.781977] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b7f5764-23c4-40f8-a618-0c608e0e987d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.782050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b7f5764-23c4-40f8-a618-0c608e0e987d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.783281] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b7f5764-23c4-40f8-a618-0c608e0e987d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.783281] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b7f5764-23c4-40f8-a618-0c608e0e987d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.285779] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.286023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.286283] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b7f5764-23c4-40f8-a618-0c608e0e987d with status ACTIVE [ 893.286689] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.286858] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.286958] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.287269] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.287400] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.287631] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.287761] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.287860] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.288086] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.288463] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.288463] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.288616] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.288668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.288907] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.290025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.290025] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b7f5764-23c4-40f8-a618-0c608e0e987d is going to be updated. [ 893.315139] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.315139] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.315268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.315851] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.315851] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.316016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b7f5764-23c4-40f8-a618-0c608e0e987d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.765189] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1a5abeb-ac32-4d23-a23f-c0ae308abad8 in Status: SUCCESS [ 893.769019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.944111] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: SUCCESS [ 893.944669] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.944669] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.944976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.944976] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.973175] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: SUCCESS [ 893.973627] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.974086] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.975409] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.975653] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.975817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.975915] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.976129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.976756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.976756] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.066044] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7b62144-a34e-4e44-9dda-a1306bb3fa05 in Status: SUCCESS [ 894.066278] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.066499] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.066762] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.066966] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.067095] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.067388] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.067388] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.067388] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.067509] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.067561] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7b62144-a34e-4e44-9dda-a1306bb3fa05',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.450593] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.450795] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.450879] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.451123] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.451304] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.451408] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.451474] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.451629] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.451720] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.451811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.451904] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.480639] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.570575] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7b62144-a34e-4e44-9dda-a1306bb3fa05 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.570575] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.570575] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.570830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.570830] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.570918] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.570953] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.571128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.571220] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.571310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.571457] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7b62144-a34e-4e44-9dda-a1306bb3fa05 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.571557] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.571636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.571784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.571924] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.572060] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.572106] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.572330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.572441] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.572527] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.572690] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7b62144-a34e-4e44-9dda-a1306bb3fa05',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.575606] env[69920]: INFO networking_nsxv3.common.synchronization [req-a523c018-edfc-4364-abc5-79911f55c111 req-6cadf6a3-1b6f-4820-8a0f-c9387e07372b tempest-ServersTestBootFromVolume-1196685189 tempest-ServersTestBootFromVolume-1196685189-project-member] Enqueued Resource ID: 361f5d4b-d775-40f2-9486-50f4511d4852 with Priority: HIGHEST for action security_group_members [ 894.576742] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 361f5d4b-d775-40f2-9486-50f4511d4852 with Priority: HIGHEST for action security_group_members [ 894.576742] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-361f5d4b-d775-40f2-9486-50f4511d4852 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.576742] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.576742] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.577054] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.577054] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.577324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.577324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.577422] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.577466] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.577551] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('361f5d4b-d775-40f2-9486-50f4511d4852',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.955760] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.955760] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.959249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.959249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.959249] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.959249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.959249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.959249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.959249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.959249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.959249] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.959249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.959249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.959249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.959249] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.959249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.959249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.959249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.959249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.959249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.959857] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.986389] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.076671] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7b62144-a34e-4e44-9dda-a1306bb3fa05: rpc.has_security_group_logging(os_id): False [ 895.082172] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.082172] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.082172] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.082172] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.101610] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.101853] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.122440] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.123472] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.123472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.123472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.123807] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.123807] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.123807] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 361f5d4b-d775-40f2-9486-50f4511d4852 is going to be updated. [ 895.125663] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.125954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.126115] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.126415] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.126585] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.126633] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.126837] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.126935] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.128287] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.128524] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.128524] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.128720] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.128785] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.129063] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.129321] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.129485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.129721] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.129855] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.129991] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7b62144-a34e-4e44-9dda-a1306bb3fa05 is going to be created. [ 895.137341] env[69920]: INFO networking_nsxv3.common.synchronization [req-8aabfc2b-4378-470b-8b13-822f0f1bcd06 req-f8707ffa-7738-4d9d-826e-a3bc5c173f73 tempest-ServerDiskConfigTestJSON-714416826 tempest-ServerDiskConfigTestJSON-714416826-project-member] Enqueued Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 895.138986] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 895.138986] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.139222] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.139371] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.141023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.141023] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.141023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.141397] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.141442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.141595] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.142521] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.179825] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.180550] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.180731] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.181094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.181407] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.196558] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 361f5d4b-d775-40f2-9486-50f4511d4852 in Status: IN_PROGRESS for 2s [ 895.220011] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.223282] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.223826] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.223826] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.223957] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.239927] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7b62144-a34e-4e44-9dda-a1306bb3fa05 in Status: IN_PROGRESS for 2s [ 895.460946] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7aae69a5-1701-43e9-9978-86df7a832270: rpc.has_security_group_logging(os_id): False [ 895.488920] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.489163] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.489257] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.489532] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.489664] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.489782] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a is going to be updated. [ 895.495258] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.500747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.500747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.500747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.500747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.500747] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.500747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.500747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.500747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.500747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.500747] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.500747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.500747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.500747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.500747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.502100] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.502100] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.502100] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.502100] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.502100] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.502100] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 is going to be updated. [ 895.544145] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.544145] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.544145] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.544472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.544554] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.554104] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: IN_PROGRESS for 2s [ 895.586594] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.586781] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.586843] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.589310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.589310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.622151] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: IN_PROGRESS for 2s [ 895.647559] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.647559] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.647559] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.647559] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.647559] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.647559] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.647559] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.647559] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.647559] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.647559] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.647559] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 is going to be updated. [ 895.694089] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.694560] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.694560] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.694560] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.694705] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.712285] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: IN_PROGRESS for 2s [ 897.206700] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 361f5d4b-d775-40f2-9486-50f4511d4852 in Status: SUCCESS [ 897.207080] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 361f5d4b-d775-40f2-9486-50f4511d4852 deletion is rescheduled due to dependency. [ 897.207080] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.255708] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7b62144-a34e-4e44-9dda-a1306bb3fa05 in Status: SUCCESS [ 897.255925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.571930] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: SUCCESS [ 897.571930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.571930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.571930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.571930] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.571930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.571930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.571930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.571930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.571930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.571930] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.636823] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: SUCCESS [ 897.636823] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.721163] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: SUCCESS [ 897.721163] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 deletion is rescheduled due to dependency. [ 897.721397] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.076559] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.076718] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.076830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.077342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.077342] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.077436] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.077436] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.077651] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.077721] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.077771] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.078206] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.078292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.078292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.078437] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.078606] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.079018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.079119] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.079270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.079362] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.079439] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.079556] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.583244] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 154896d4-d0bc-49e9-8d89-5fcc04260b1a: rpc.has_security_group_logging(os_id): False [ 898.612479] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.612479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.612479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.612479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.639276] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.639828] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.639828] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.639992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.640184] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.640258] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.640495] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.640627] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.640713] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.641092] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.641255] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.641510] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.641585] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.641639] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.641798] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.641880] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.641990] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a is going to be updated. [ 898.749729] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.749729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.749729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.749729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.749729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.769279] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: IN_PROGRESS for 2s [ 900.139956] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 900.140277] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 900.368504] env[69920]: INFO networking_nsxv3.common.synchronization [req-f8aaeaed-ed76-4327-b92c-00dc9be5973a req-753e3ac0-08cc-4fb4-9530-87eae7066fe8 tempest-ServersTestMultiNic-1807665099 tempest-ServersTestMultiNic-1807665099-project-member] Enqueued Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 900.369123] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 900.369454] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.369584] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.369654] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.369856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.370012] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.370745] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.370825] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.371028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.371131] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.371232] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.783094] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: SUCCESS [ 900.783378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.878211] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.155785] env[69920]: INFO networking_nsxv3.common.synchronization [req-f8aaeaed-ed76-4327-b92c-00dc9be5973a req-910dcbd6-4fa1-4366-93ed-e9b61b8b86c1 tempest-ServersTestMultiNic-1807665099 tempest-ServersTestMultiNic-1807665099-project-member] Enqueued Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 901.155785] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 901.155785] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.155785] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.380782] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.888594] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.888594] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.888594] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.888594] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.888594] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.888594] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 is going to be updated. [ 901.931029] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.931029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.931029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.931029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.931029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.944359] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: IN_PROGRESS for 2s [ 902.030929] env[69920]: INFO networking_nsxv3.common.synchronization [req-79d24ada-57d5-47b4-8461-c9b1d38e6fe1 req-2380b9d0-2f90-4985-84e2-5c962f195eee tempest-AttachVolumeTestJSON-218421131 tempest-AttachVolumeTestJSON-218421131-project-member] Enqueued Resource ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 with Priority: HIGHEST for action security_group_members [ 902.030929] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 with Priority: HIGHEST for action security_group_members [ 902.031253] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a8bd4df-a8df-4d64-94ea-a00a62c48a01 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.032236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.032384] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.032901] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.033032] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.033236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.033314] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.033540] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.033646] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.033758] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a8bd4df-a8df-4d64-94ea-a00a62c48a01',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.057692] env[69920]: INFO networking_nsxv3.common.synchronization [req-f8aaeaed-ed76-4327-b92c-00dc9be5973a req-329ed621-5fcf-4bb1-8b9f-367a1c4cb7d1 tempest-ServersTestMultiNic-1807665099 tempest-ServersTestMultiNic-1807665099-project-member] Enqueued Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 902.058818] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 902.062646] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.062646] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.539371] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.539845] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.539845] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.539845] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.566270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.566613] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.566760] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.566831] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.567048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.567139] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.567231] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 is going to be updated. [ 902.597812] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.597812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.597812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.597812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.597812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.609125] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 in Status: IN_PROGRESS for 2s [ 902.628756] env[69920]: INFO networking_nsxv3.common.synchronization [req-b2a29509-92c3-40cd-aaaa-ddc88781f034 req-554a55dc-f5f6-468f-a448-ae88b3f9570f tempest-ServersAdminNegativeTestJSON-439752242 tempest-ServersAdminNegativeTestJSON-439752242-project-member] Enqueued Resource ID: 33cfaadf-9929-4bc4-a275-43f890595f10 with Priority: HIGHEST for action security_group_members [ 902.628756] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33cfaadf-9929-4bc4-a275-43f890595f10 with Priority: HIGHEST for action security_group_members [ 902.630201] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-33cfaadf-9929-4bc4-a275-43f890595f10 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.630979] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.631183] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.631514] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.631795] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.632042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.632191] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.632434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.632624] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.632801] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33cfaadf-9929-4bc4-a275-43f890595f10',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.140052] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.140393] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.140482] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.140726] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.140872] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.142105] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.142376] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.142496] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.143653] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.143653] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.143653] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33cfaadf-9929-4bc4-a275-43f890595f10 already deleted. [ 903.143653] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.517026] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-207 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.517026] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.517026] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.517026] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.517026] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.517026] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.517026] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.517026] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.517026] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.517842] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 903.517842] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 903.517842] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 903.517842] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 903.518087] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 903.518141] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 903.518348] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 903.540509] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 903.541121] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 903.541121] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 903.541379] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.541880] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-afbb315a-bc71-453c-9b30-ef008a6e400e taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.542193] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-afbb315a-bc71-453c-9b30-ef008a6e400e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.542411] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-afbb315a-bc71-453c-9b30-ef008a6e400e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.542936] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-afbb315a-bc71-453c-9b30-ef008a6e400e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.545202] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afbb315a-bc71-453c-9b30-ef008a6e400e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.767719] env[69920]: INFO networking_nsxv3.common.synchronization [None req-3fab6095-d0d5-4fb2-af6b-81a068ff2e58 None None] Enqueued Resource ID: 6ac00812-d7e4-4fb7-bb27-383f4e6afacd with Priority: HIGHEST for action port [ 903.767719] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ac00812-d7e4-4fb7-bb27-383f4e6afacd with Priority: HIGHEST for action port [ 903.767719] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ac00812-d7e4-4fb7-bb27-383f4e6afacd taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.767719] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ac00812-d7e4-4fb7-bb27-383f4e6afacd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.767719] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ac00812-d7e4-4fb7-bb27-383f4e6afacd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.767719] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ac00812-d7e4-4fb7-bb27-383f4e6afacd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.767719] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ac00812-d7e4-4fb7-bb27-383f4e6afacd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.007472] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: SUCCESS [ 904.007890] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.008300] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.008564] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.008765] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.008954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.009060] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.009374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.009374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.009477] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.048167] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.048779] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.048779] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.048933] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.049146] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.049311] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port afbb315a-bc71-453c-9b30-ef008a6e400e not found, creating... [ 904.049595] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.049994] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.049994] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.050119] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.050263] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.050549] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.051324] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.051324] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.051324] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.051862] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.051862] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: afbb315a-bc71-453c-9b30-ef008a6e400e is going to be created. [ 904.074303] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.074303] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.074492] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.074803] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.077932] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.077932] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-afbb315a-bc71-453c-9b30-ef008a6e400e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.270048] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ac00812-d7e4-4fb7-bb27-383f4e6afacd [ 904.270284] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.270423] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.270495] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.270722] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.270813] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.270910] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ac00812-d7e4-4fb7-bb27-383f4e6afacd already deleted. [ 904.270990] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ac00812-d7e4-4fb7-bb27-383f4e6afacd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.513763] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.513763] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.513763] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.513763] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.513763] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.513763] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.513763] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.513763] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.513763] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.513763] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.513763] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 is going to be updated. [ 904.552858] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.553171] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.553171] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.553278] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.553414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.565605] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: IN_PROGRESS for 2s [ 904.620584] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 in Status: SUCCESS [ 904.620804] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a8bd4df-a8df-4d64-94ea-a00a62c48a01 deletion is rescheduled due to dependency. [ 904.621402] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a8bd4df-a8df-4d64-94ea-a00a62c48a01" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.650828] env[69920]: INFO networking_nsxv3.common.synchronization [None req-33985246-5bcd-4377-aea5-cf9b5bd5fa5d None None] Enqueued Resource ID: 7ad79ff6-21e2-4593-9bba-2c42d1524656 with Priority: HIGHEST for action port [ 904.650828] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ad79ff6-21e2-4593-9bba-2c42d1524656 with Priority: HIGHEST for action port [ 904.650828] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ad79ff6-21e2-4593-9bba-2c42d1524656 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.650828] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ad79ff6-21e2-4593-9bba-2c42d1524656" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.651645] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ad79ff6-21e2-4593-9bba-2c42d1524656" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.652014] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ad79ff6-21e2-4593-9bba-2c42d1524656" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.652231] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ad79ff6-21e2-4593-9bba-2c42d1524656',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.032745] env[69920]: INFO networking_nsxv3.common.synchronization [req-f039d20d-dca6-408c-a5f2-cbd7c8654716 req-8413122b-09d6-4341-91fc-279ff10b6856 tempest-VolumesAssistedSnapshotsTest-131898001 tempest-VolumesAssistedSnapshotsTest-131898001-project-member] Enqueued Resource ID: b6124cb4-db5b-4093-b85f-7d68bc614215 with Priority: HIGHEST for action security_group_members [ 905.034160] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6124cb4-db5b-4093-b85f-7d68bc614215 with Priority: HIGHEST for action security_group_members [ 905.034896] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6124cb4-db5b-4093-b85f-7d68bc614215 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.034896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.034896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.035166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.035211] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.035325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.035361] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.036711] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.036759] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.037302] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6124cb4-db5b-4093-b85f-7d68bc614215',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.154229] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ad79ff6-21e2-4593-9bba-2c42d1524656 [ 905.154471] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.154665] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.154809] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.157445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.157568] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.157694] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ad79ff6-21e2-4593-9bba-2c42d1524656 already deleted. [ 905.157792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ad79ff6-21e2-4593-9bba-2c42d1524656" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.440230] env[69920]: INFO networking_nsxv3.common.synchronization [req-b2a29509-92c3-40cd-aaaa-ddc88781f034 req-28089e80-6e6b-4c92-87d1-622a388e341e service nova] Enqueued Resource ID: 33cfaadf-9929-4bc4-a275-43f890595f10 with Priority: HIGHEST for action security_group_rules [ 905.440230] env[69920]: INFO networking_nsxv3.common.synchronization [req-b2a29509-92c3-40cd-aaaa-ddc88781f034 req-28089e80-6e6b-4c92-87d1-622a388e341e service nova] Enqueued Resource ID: 33cfaadf-9929-4bc4-a275-43f890595f10 with Priority: HIGHEST for action security_group_members [ 905.440230] env[69920]: INFO networking_nsxv3.common.synchronization [req-b2a29509-92c3-40cd-aaaa-ddc88781f034 req-28089e80-6e6b-4c92-87d1-622a388e341e service nova] Enqueued Resource ID: afbb315a-bc71-453c-9b30-ef008a6e400e with Priority: HIGHEST for action port [ 905.440230] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33cfaadf-9929-4bc4-a275-43f890595f10 with Priority: HIGHEST for action security_group_rules [ 905.440230] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33cfaadf-9929-4bc4-a275-43f890595f10 with Priority: HIGHEST for action security_group_members [ 905.440230] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afbb315a-bc71-453c-9b30-ef008a6e400e with Priority: HIGHEST for action port [ 905.441502] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33cfaadf-9929-4bc4-a275-43f890595f10 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.441584] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.441664] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.442352] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.442352] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33cfaadf-9929-4bc4-a275-43f890595f10',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.444827] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-33cfaadf-9929-4bc4-a275-43f890595f10 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.444827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.444827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.444827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.444827] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.444827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.444827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.444827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.444827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.444827] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33cfaadf-9929-4bc4-a275-43f890595f10',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.447240] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-afbb315a-bc71-453c-9b30-ef008a6e400e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.447240] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afbb315a-bc71-453c-9b30-ef008a6e400e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.447240] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afbb315a-bc71-453c-9b30-ef008a6e400e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.447240] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afbb315a-bc71-453c-9b30-ef008a6e400e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.447240] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afbb315a-bc71-453c-9b30-ef008a6e400e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.539914] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.540080] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.540153] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.540364] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.540458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.540653] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.540753] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.540817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.540972] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.541062] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.541150] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6124cb4-db5b-4093-b85f-7d68bc614215 is going to be updated. [ 905.577144] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.577427] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.577427] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.577574] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.577718] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.588345] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6124cb4-db5b-4093-b85f-7d68bc614215 in Status: IN_PROGRESS for 2s [ 905.947527] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-33cfaadf-9929-4bc4-a275-43f890595f10 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.947976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.948338] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33cfaadf-9929-4bc4-a275-43f890595f10',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.949611] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port afbb315a-bc71-453c-9b30-ef008a6e400e with status ACTIVE [ 905.949950] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.950206] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.950359] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.950654] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.950835] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.951206] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.951654] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.951804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.952091] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.958926] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.958926] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.958926] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.958926] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.958926] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.958926] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.958926] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: afbb315a-bc71-453c-9b30-ef008a6e400e is going to be updated. [ 905.980893] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.981097] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.981328] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.981390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.981546] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.981982] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afbb315a-bc71-453c-9b30-ef008a6e400e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.070958] env[69920]: INFO networking_nsxv3.common.synchronization [None req-66510f98-2d8a-4bf0-9bcd-dc604e957979 None None] Enqueued Resource ID: 57bc25ab-724c-48e8-b7a4-3f64647ad2de with Priority: HIGHEST for action port [ 906.071700] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bc25ab-724c-48e8-b7a4-3f64647ad2de with Priority: HIGHEST for action port [ 906.072862] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-57bc25ab-724c-48e8-b7a4-3f64647ad2de taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.073046] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57bc25ab-724c-48e8-b7a4-3f64647ad2de" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.073188] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57bc25ab-724c-48e8-b7a4-3f64647ad2de" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.073616] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57bc25ab-724c-48e8-b7a4-3f64647ad2de" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.073723] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57bc25ab-724c-48e8-b7a4-3f64647ad2de',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.458832] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33cfaadf-9929-4bc4-a275-43f890595f10',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.575791] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: SUCCESS [ 906.575944] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 deletion is rescheduled due to dependency. [ 906.576028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.576201] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.576429] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.576651] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.576764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.576806] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.576962] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.577183] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.577426] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.581406] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 57bc25ab-724c-48e8-b7a4-3f64647ad2de [ 906.581589] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.581698] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.581858] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.581928] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.582023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.582129] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:57bc25ab-724c-48e8-b7a4-3f64647ad2de already deleted. [ 906.582190] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57bc25ab-724c-48e8-b7a4-3f64647ad2de" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.681556] env[69920]: INFO networking_nsxv3.common.synchronization [req-76d1e1b1-31cf-40ac-8586-29499da0f9a5 req-c5dda8dc-199a-43cf-ad97-e72e4d79d120 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 906.682091] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 906.682384] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.682531] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.682587] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.683745] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.683934] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.686022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.686022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.686022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.686022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.686022] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.964836] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.965015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.965103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.965331] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.965381] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.965479] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33cfaadf-9929-4bc4-a275-43f890595f10 is going to be created. [ 906.998059] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.998059] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.998059] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.998059] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.998059] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.013691] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33cfaadf-9929-4bc4-a275-43f890595f10 in Status: UNINITIALIZED for 2s [ 907.081029] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.083261] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.083261] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.083261] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.083261] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.083261] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.083261] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.083261] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.083261] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.083261] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.083261] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 is going to be updated. [ 907.116831] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.116831] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.116831] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.116831] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.117168] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.130186] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: IN_PROGRESS for 2s [ 907.153152] env[69920]: INFO networking_nsxv3.common.synchronization [req-e9a04872-41a4-44ac-952d-10ef4191b814 req-efc2a270-9149-4be7-bba7-49391b428e41 tempest-SecurityGroupRulesTestJSON-286964149 tempest-SecurityGroupRulesTestJSON-286964149-project-member] Enqueued Resource ID: 93d04702-f394-44de-95db-46a49799e8fc with Priority: HIGHEST for action security_group_rules [ 907.153655] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93d04702-f394-44de-95db-46a49799e8fc with Priority: HIGHEST for action security_group_rules [ 907.153973] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93d04702-f394-44de-95db-46a49799e8fc taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.154167] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93d04702-f394-44de-95db-46a49799e8fc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.154167] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93d04702-f394-44de-95db-46a49799e8fc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.154707] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93d04702-f394-44de-95db-46a49799e8fc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.154707] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93d04702-f394-44de-95db-46a49799e8fc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.186153] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.368753] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-331 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.369332] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-331" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.370175] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-331" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.372257] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-331" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.372257] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.372257] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.372257] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.372257] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.372257] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.372257] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 907.372257] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 907.372534] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 907.372534] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 907.372717] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 907.372758] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 907.372972] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 907.393497] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 907.393734] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 907.393887] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 907.394324] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-331" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.394716] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-6e95f83c-01f6-4bbe-800b-ed805d60f684 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.394908] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-6e95f83c-01f6-4bbe-800b-ed805d60f684" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.395048] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-6e95f83c-01f6-4bbe-800b-ed805d60f684" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.395456] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-6e95f83c-01f6-4bbe-800b-ed805d60f684" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.395652] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e95f83c-01f6-4bbe-800b-ed805d60f684',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.602685] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6124cb4-db5b-4093-b85f-7d68bc614215 in Status: SUCCESS [ 907.602685] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6124cb4-db5b-4093-b85f-7d68bc614215 deletion is rescheduled due to dependency. [ 907.602685] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.680046] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.680394] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.680394] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.680614] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.680712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.680987] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93d04702-f394-44de-95db-46a49799e8fc already deleted. [ 907.680987] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93d04702-f394-44de-95db-46a49799e8fc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.687802] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.900531] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.901115] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.901288] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.901586] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.901750] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.901972] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 6e95f83c-01f6-4bbe-800b-ed805d60f684 not found, creating... [ 907.902291] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.902461] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.902589] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.902849] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.904108] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.904605] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.905074] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.905293] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.905755] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.905957] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.906167] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 6e95f83c-01f6-4bbe-800b-ed805d60f684 is going to be created. [ 907.931315] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.931936] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.931936] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.932236] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.932458] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.933338] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-6e95f83c-01f6-4bbe-800b-ed805d60f684" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.024580] env[69920]: INFO networking_nsxv3.common.synchronization [None req-297c268e-a93f-4be3-90c6-07196be74184 None None] Enqueued Resource ID: 2bae43c2-79bf-4528-9d93-f9906468d6e4 with Priority: HIGHEST for action port [ 908.025399] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bae43c2-79bf-4528-9d93-f9906468d6e4 with Priority: HIGHEST for action port [ 908.030271] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bae43c2-79bf-4528-9d93-f9906468d6e4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.030271] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bae43c2-79bf-4528-9d93-f9906468d6e4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.030271] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bae43c2-79bf-4528-9d93-f9906468d6e4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.030271] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bae43c2-79bf-4528-9d93-f9906468d6e4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.030271] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bae43c2-79bf-4528-9d93-f9906468d6e4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.190947] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.191161] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.191206] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.191423] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.191525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.191834] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 is going to be updated. [ 908.227242] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.227378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.227446] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.227666] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.227806] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.237964] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: IN_PROGRESS for 2s [ 908.248719] env[69920]: INFO networking_nsxv3.common.synchronization [req-fe0e5080-6d65-4a9c-af28-89d37a3793f2 req-4c17646b-05c5-4b4e-afbd-844ba556fdb4 tempest-SecurityGroupRulesTestJSON-286964149 tempest-SecurityGroupRulesTestJSON-286964149-project-member] Enqueued Resource ID: ca9a2dd9-0cdb-4b2e-9f3e-9389734f8f5a with Priority: HIGHEST for action security_group_rules [ 908.248719] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca9a2dd9-0cdb-4b2e-9f3e-9389734f8f5a with Priority: HIGHEST for action security_group_rules [ 908.249751] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca9a2dd9-0cdb-4b2e-9f3e-9389734f8f5a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.249751] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca9a2dd9-0cdb-4b2e-9f3e-9389734f8f5a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.249751] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca9a2dd9-0cdb-4b2e-9f3e-9389734f8f5a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.249989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca9a2dd9-0cdb-4b2e-9f3e-9389734f8f5a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.249989] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca9a2dd9-0cdb-4b2e-9f3e-9389734f8f5a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.324954] env[69920]: INFO networking_nsxv3.common.synchronization [None req-6a83e43f-9969-4212-857f-a3b6c57216eb None None] Enqueued Resource ID: 0650262f-8961-4477-bef9-8be48f4b9e9d with Priority: HIGHEST for action port [ 908.325717] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0650262f-8961-4477-bef9-8be48f4b9e9d with Priority: HIGHEST for action port [ 908.327784] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-0650262f-8961-4477-bef9-8be48f4b9e9d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.327784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0650262f-8961-4477-bef9-8be48f4b9e9d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.327784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0650262f-8961-4477-bef9-8be48f4b9e9d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.327784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0650262f-8961-4477-bef9-8be48f4b9e9d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.327784] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0650262f-8961-4477-bef9-8be48f4b9e9d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.329854] env[69920]: INFO networking_nsxv3.common.synchronization [req-d5c2e27f-7947-4a74-bd23-32983dcdd92c req-64d31e81-669c-42a0-a608-6268567edbf2 tempest-VolumesAdminNegativeTest-1491739297 tempest-VolumesAdminNegativeTest-1491739297-project-member] Enqueued Resource ID: a7b62144-a34e-4e44-9dda-a1306bb3fa05 with Priority: HIGHEST for action security_group_members [ 908.330454] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7b62144-a34e-4e44-9dda-a1306bb3fa05 with Priority: HIGHEST for action security_group_members [ 908.330777] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7b62144-a34e-4e44-9dda-a1306bb3fa05 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.330943] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.330943] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.331193] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.331490] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.331799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.331799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.331939] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.331939] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.332030] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7b62144-a34e-4e44-9dda-a1306bb3fa05',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.531762] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2bae43c2-79bf-4528-9d93-f9906468d6e4 [ 908.532038] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.532190] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.532257] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.532851] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.534561] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.535102] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2bae43c2-79bf-4528-9d93-f9906468d6e4 already deleted. [ 908.535102] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bae43c2-79bf-4528-9d93-f9906468d6e4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.773756] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.774128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.774128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.774301] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.774301] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.774429] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca9a2dd9-0cdb-4b2e-9f3e-9389734f8f5a already deleted. [ 908.774516] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca9a2dd9-0cdb-4b2e-9f3e-9389734f8f5a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.831187] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0650262f-8961-4477-bef9-8be48f4b9e9d [ 908.831296] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.831419] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.831487] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.831816] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.831816] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.831918] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0650262f-8961-4477-bef9-8be48f4b9e9d already deleted. [ 908.831998] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0650262f-8961-4477-bef9-8be48f4b9e9d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.834531] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.834860] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.834860] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.834995] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.834995] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.835197] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.835298] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.835365] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.835679] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.835679] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.835679] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7b62144-a34e-4e44-9dda-a1306bb3fa05 is going to be updated. [ 908.861938] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.862040] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.862135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.862282] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.862403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.872994] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7b62144-a34e-4e44-9dda-a1306bb3fa05 in Status: IN_PROGRESS for 2s [ 908.884930] env[69920]: INFO networking_nsxv3.common.synchronization [req-76d1e1b1-31cf-40ac-8586-29499da0f9a5 req-e8026fc5-08a5-4122-8d51-ff78733e9647 service nova] Enqueued Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_rules [ 908.885127] env[69920]: INFO networking_nsxv3.common.synchronization [req-76d1e1b1-31cf-40ac-8586-29499da0f9a5 req-e8026fc5-08a5-4122-8d51-ff78733e9647 service nova] Enqueued Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 908.885286] env[69920]: INFO networking_nsxv3.common.synchronization [req-76d1e1b1-31cf-40ac-8586-29499da0f9a5 req-e8026fc5-08a5-4122-8d51-ff78733e9647 service nova] Enqueued Resource ID: 6e95f83c-01f6-4bbe-800b-ed805d60f684 with Priority: HIGHEST for action port [ 908.885522] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_rules [ 908.885673] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 908.885798] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e95f83c-01f6-4bbe-800b-ed805d60f684 with Priority: HIGHEST for action port [ 908.886343] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.886464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.886527] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.886765] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.886849] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.888642] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.888770] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.889064] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e95f83c-01f6-4bbe-800b-ed805d60f684 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.889217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e95f83c-01f6-4bbe-800b-ed805d60f684" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.889287] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e95f83c-01f6-4bbe-800b-ed805d60f684" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.889472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e95f83c-01f6-4bbe-800b-ed805d60f684" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.889550] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e95f83c-01f6-4bbe-800b-ed805d60f684',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.023401] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33cfaadf-9929-4bc4-a275-43f890595f10 in Status: SUCCESS [ 909.024201] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.024201] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.024201] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.024402] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.024402] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.024503] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.024625] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.024708] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.024798] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.024898] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33cfaadf-9929-4bc4-a275-43f890595f10',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.142043] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: IN_PROGRESS for 4s [ 909.296815] env[69920]: INFO networking_nsxv3.common.synchronization [req-2c3f462b-c29e-4a9a-ae03-243d2b231ef1 req-b4f68022-adc4-418f-9ccd-17393ed32df4 tempest-ServerMetadataTestJSON-1221837469 tempest-ServerMetadataTestJSON-1221837469-project-member] Enqueued Resource ID: b1a5abeb-ac32-4d23-a23f-c0ae308abad8 with Priority: HIGHEST for action security_group_members [ 909.297384] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a5abeb-ac32-4d23-a23f-c0ae308abad8 with Priority: HIGHEST for action security_group_members [ 909.298301] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.298443] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.298516] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.299048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.299222] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.299362] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.299437] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.299632] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.299943] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.300126] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1a5abeb-ac32-4d23-a23f-c0ae308abad8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.392088] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.392088] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.397031] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e95f83c-01f6-4bbe-800b-ed805d60f684 with status ACTIVE [ 909.397031] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.397031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.397031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.397031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.397031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.397031] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.397031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.397031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.397031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.397031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.397031] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.397031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.397031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.397031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.397031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.397031] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e95f83c-01f6-4bbe-800b-ed805d60f684 is going to be updated. [ 909.421901] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.422150] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.422271] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.422520] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.422673] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.422901] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e95f83c-01f6-4bbe-800b-ed805d60f684" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.527529] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-33cfaadf-9929-4bc4-a275-43f890595f10 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.527691] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.527756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.528449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.529351] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.529351] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.529351] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.529351] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.529351] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.529351] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.529807] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-33cfaadf-9929-4bc4-a275-43f890595f10 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.529807] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.529807] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.529807] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.530308] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.530308] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.530308] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.530445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.530483] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.530566] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.530665] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33cfaadf-9929-4bc4-a275-43f890595f10',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.802785] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.803111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.803111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.803298] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.803436] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.803540] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.803637] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.803729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.803945] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.804040] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.804162] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a5abeb-ac32-4d23-a23f-c0ae308abad8 is going to be updated. [ 909.833342] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.833591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.833662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.833905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.834423] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.843609] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a5abeb-ac32-4d23-a23f-c0ae308abad8 in Status: IN_PROGRESS for 2s [ 910.032676] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33cfaadf-9929-4bc4-a275-43f890595f10: rpc.has_security_group_logging(os_id): False [ 910.066026] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.066026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.066026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.066026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.066026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.066026] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.066026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.066026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.066026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.066026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.066026] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.066026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.066026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.066026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.066026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.066811] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.066811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.066811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.066811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.066811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.066811] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33cfaadf-9929-4bc4-a275-43f890595f10 is going to be created. [ 910.164606] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.164804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.164906] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.165190] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.165452] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.179626] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33cfaadf-9929-4bc4-a275-43f890595f10 in Status: IN_PROGRESS for 2s [ 910.255431] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: SUCCESS [ 910.255785] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.256055] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.256304] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.256512] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.256697] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.256778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.256972] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.257088] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.257202] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.398295] env[69920]: INFO networking_nsxv3.common.synchronization [req-ea23a7dc-ca30-4e54-be2b-9cdcb8812bf9 req-43670d63-8ba2-4840-a9f9-c2541fa87749 tempest-SecurityGroupRulesTestJSON-286964149 tempest-SecurityGroupRulesTestJSON-286964149-project-member] Enqueued Resource ID: 2127bdc9-e14f-4869-9fe6-43b6532b6555 with Priority: HIGHEST for action security_group_rules [ 910.398941] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2127bdc9-e14f-4869-9fe6-43b6532b6555 with Priority: HIGHEST for action security_group_rules [ 910.399262] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2127bdc9-e14f-4869-9fe6-43b6532b6555 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.399391] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2127bdc9-e14f-4869-9fe6-43b6532b6555" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.399487] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2127bdc9-e14f-4869-9fe6-43b6532b6555" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.399795] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2127bdc9-e14f-4869-9fe6-43b6532b6555" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.399957] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2127bdc9-e14f-4869-9fe6-43b6532b6555',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.715198] env[69920]: INFO networking_nsxv3.common.synchronization [None req-db633b2a-0656-4b61-867f-7b6b57ba579f None None] Enqueued Resource ID: 861fe237-dd9a-405c-ada8-6b560abe676c with Priority: HIGHEST for action port [ 910.715575] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 861fe237-dd9a-405c-ada8-6b560abe676c with Priority: HIGHEST for action port [ 910.715870] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-861fe237-dd9a-405c-ada8-6b560abe676c taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.715996] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-861fe237-dd9a-405c-ada8-6b560abe676c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.717178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-861fe237-dd9a-405c-ada8-6b560abe676c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.717456] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-861fe237-dd9a-405c-ada8-6b560abe676c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.717599] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('861fe237-dd9a-405c-ada8-6b560abe676c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.760506] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.884952] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7b62144-a34e-4e44-9dda-a1306bb3fa05 in Status: SUCCESS [ 910.885255] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7b62144-a34e-4e44-9dda-a1306bb3fa05 deletion is rescheduled due to dependency. [ 910.885312] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.924372] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.924614] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.924759] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.925032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.925186] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.925360] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2127bdc9-e14f-4869-9fe6-43b6532b6555 already deleted. [ 910.925492] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2127bdc9-e14f-4869-9fe6-43b6532b6555" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.151847] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: SUCCESS [ 911.152182] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 deletion is rescheduled due to dependency. [ 911.152315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.221032] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 861fe237-dd9a-405c-ada8-6b560abe676c [ 911.221032] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.221032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.221032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.221032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.221032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.221032] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:861fe237-dd9a-405c-ada8-6b560abe676c already deleted. [ 911.221032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-861fe237-dd9a-405c-ada8-6b560abe676c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.265716] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.769052] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.769052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.769052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.769052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.769327] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.769327] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 is going to be updated. [ 911.798047] env[69920]: INFO networking_nsxv3.common.synchronization [req-2ea88dc5-8b4a-4083-9539-f45c745a015a req-7779a6be-789f-48d1-b4b3-cc3ca008915e tempest-SecurityGroupRulesTestJSON-286964149 tempest-SecurityGroupRulesTestJSON-286964149-project-member] Enqueued Resource ID: 75e262a7-7215-4dd1-a8c3-2635e745c546 with Priority: HIGHEST for action security_group_rules [ 911.799215] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.799357] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.799427] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.799634] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.799781] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.801016] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e262a7-7215-4dd1-a8c3-2635e745c546 with Priority: HIGHEST for action security_group_rules [ 911.801347] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75e262a7-7215-4dd1-a8c3-2635e745c546 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.801460] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75e262a7-7215-4dd1-a8c3-2635e745c546" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.801528] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75e262a7-7215-4dd1-a8c3-2635e745c546" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.801749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75e262a7-7215-4dd1-a8c3-2635e745c546" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.801834] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75e262a7-7215-4dd1-a8c3-2635e745c546',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.810979] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: IN_PROGRESS for 2s [ 911.854071] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1a5abeb-ac32-4d23-a23f-c0ae308abad8 in Status: SUCCESS [ 911.854329] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1a5abeb-ac32-4d23-a23f-c0ae308abad8 deletion is rescheduled due to dependency. [ 911.854524] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.196132] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33cfaadf-9929-4bc4-a275-43f890595f10 in Status: SUCCESS [ 912.196583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.321551] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.321764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.321764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.321990] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.322097] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.322198] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75e262a7-7215-4dd1-a8c3-2635e745c546 already deleted. [ 912.322279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75e262a7-7215-4dd1-a8c3-2635e745c546" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.760220] env[69920]: INFO networking_nsxv3.common.synchronization [req-c5e15c79-6e13-434e-95c6-b7c4148bce85 req-68acecd5-998a-47cb-8d38-0092cd0b8c68 tempest-SecurityGroupRulesTestJSON-286964149 tempest-SecurityGroupRulesTestJSON-286964149-project-member] Enqueued Resource ID: 789be2b7-71c8-48aa-81c5-964fa5207a7f with Priority: HIGHEST for action security_group_rules [ 912.760791] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789be2b7-71c8-48aa-81c5-964fa5207a7f with Priority: HIGHEST for action security_group_rules [ 912.761446] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-789be2b7-71c8-48aa-81c5-964fa5207a7f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.761585] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-789be2b7-71c8-48aa-81c5-964fa5207a7f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.761650] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-789be2b7-71c8-48aa-81c5-964fa5207a7f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.762015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-789be2b7-71c8-48aa-81c5-964fa5207a7f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.762103] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('789be2b7-71c8-48aa-81c5-964fa5207a7f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.101621] env[69920]: INFO networking_nsxv3.common.synchronization [req-d0b5ad7b-c92b-4139-b3ae-b0a07bc14d28 req-65b0a8ff-b12e-4e23-846c-771b15086dc0 tempest-SecurityGroupRulesTestJSON-286964149 tempest-SecurityGroupRulesTestJSON-286964149-project-member] Enqueued Resource ID: 789be2b7-71c8-48aa-81c5-964fa5207a7f with Priority: HIGHEST for action security_group_rules [ 913.101979] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789be2b7-71c8-48aa-81c5-964fa5207a7f with Priority: HIGHEST for action security_group_rules [ 913.102377] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-789be2b7-71c8-48aa-81c5-964fa5207a7f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.102450] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-789be2b7-71c8-48aa-81c5-964fa5207a7f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.283680] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.284048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.284048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.284178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.284237] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.284337] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 789be2b7-71c8-48aa-81c5-964fa5207a7f already deleted. [ 913.284422] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-789be2b7-71c8-48aa-81c5-964fa5207a7f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.284576] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-789be2b7-71c8-48aa-81c5-964fa5207a7f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.284773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-789be2b7-71c8-48aa-81c5-964fa5207a7f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.284872] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('789be2b7-71c8-48aa-81c5-964fa5207a7f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.493878] env[69920]: INFO networking_nsxv3.common.synchronization [req-b7a82cf7-239d-4986-aa5f-43ad7ba5c9c7 req-610bf570-b470-4d80-a9f6-c38d47f7f6ca tempest-SecurityGroupRulesTestJSON-286964149 tempest-SecurityGroupRulesTestJSON-286964149-project-member] Enqueued Resource ID: 789be2b7-71c8-48aa-81c5-964fa5207a7f with Priority: HIGHEST for action security_group_rules [ 913.494444] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 789be2b7-71c8-48aa-81c5-964fa5207a7f with Priority: HIGHEST for action security_group_rules [ 913.494808] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-789be2b7-71c8-48aa-81c5-964fa5207a7f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.494925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-789be2b7-71c8-48aa-81c5-964fa5207a7f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.806745] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.806890] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.806954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.807216] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.807301] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.807399] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 789be2b7-71c8-48aa-81c5-964fa5207a7f already deleted. [ 913.807479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-789be2b7-71c8-48aa-81c5-964fa5207a7f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.807631] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-789be2b7-71c8-48aa-81c5-964fa5207a7f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.807780] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-789be2b7-71c8-48aa-81c5-964fa5207a7f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.807859] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('789be2b7-71c8-48aa-81c5-964fa5207a7f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.821136] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: SUCCESS [ 913.821334] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.821782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.822401] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.822594] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.822707] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.822771] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.822942] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.823129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.823231] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.823319] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.325103] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.325491] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.325491] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.325587] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.325771] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.325953] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.325953] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.326102] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.326174] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.326294] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.326416] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.326525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.326610] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.326787] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.327372] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.327372] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.327372] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.327372] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.327372] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.327372] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.327638] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.329140] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.329242] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.329298] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.329452] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.329578] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.329672] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 789be2b7-71c8-48aa-81c5-964fa5207a7f already deleted. [ 914.329722] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-789be2b7-71c8-48aa-81c5-964fa5207a7f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.832148] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e31e2ae5-2f08-403b-b19a-697a36f3cb16: rpc.has_security_group_logging(os_id): False [ 914.851071] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.851233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.851365] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.851517] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.851604] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.851876] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.852025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.852139] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.852344] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.852497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.852714] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.853287] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.853287] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.853287] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.853287] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.853287] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.853690] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.853690] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.853690] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.853690] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.853945] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 is going to be updated. [ 914.915672] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.915802] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.915802] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.915975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.916201] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.934198] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: IN_PROGRESS for 2s [ 916.956564] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: SUCCESS [ 916.956949] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.351382] env[69920]: INFO networking_nsxv3.common.synchronization [req-d4deab20-5b5c-4283-ab60-41cbaf353a32 req-a89d19c6-9534-4568-9dcd-ffacc1d5bd24 tempest-ServersV294TestFqdnHostnames-1367069286 tempest-ServersV294TestFqdnHostnames-1367069286-project-member] Enqueued Resource ID: 4d847f61-da82-4a79-82ae-c393059854e9 with Priority: HIGHEST for action security_group_members [ 917.352311] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d847f61-da82-4a79-82ae-c393059854e9 with Priority: HIGHEST for action security_group_members [ 917.352700] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d847f61-da82-4a79-82ae-c393059854e9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.352871] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.352973] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.353533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.353533] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.353533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.353793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.354064] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.354197] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.354331] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d847f61-da82-4a79-82ae-c393059854e9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.858399] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.858399] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.858399] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.858399] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.858399] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.858399] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.858399] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.858399] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.858399] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.858399] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.858399] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d847f61-da82-4a79-82ae-c393059854e9 already deleted. [ 917.858399] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.016174] env[69920]: INFO networking_nsxv3.common.synchronization [req-52b30179-b4cb-4eb9-878f-7abf4d202934 req-79267b37-4312-4625-ab38-7c365452dea6 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f with Priority: HIGHEST for action security_group_members [ 918.016457] env[69920]: INFO networking_nsxv3.common.synchronization [req-52b30179-b4cb-4eb9-878f-7abf4d202934 req-79267b37-4312-4625-ab38-7c365452dea6 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 918.016919] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f with Priority: HIGHEST for action security_group_members [ 918.017078] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 918.017367] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-32db8592-539e-44ed-a2b9-910bd1e0f62f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.017490] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.017767] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.017829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.018029] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.020449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.020542] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.020733] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.021054] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.021054] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32db8592-539e-44ed-a2b9-910bd1e0f62f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.021928] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.022042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.022108] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.022237] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.022391] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.022505] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.022574] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.022729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.022810] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.023093] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.139689] env[69920]: INFO networking_nsxv3.common.synchronization [req-52b30179-b4cb-4eb9-878f-7abf4d202934 req-79267b37-4312-4625-ab38-7c365452dea6 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f with Priority: HIGHEST for action security_group_rules [ 918.139689] env[69920]: INFO networking_nsxv3.common.synchronization [req-52b30179-b4cb-4eb9-878f-7abf4d202934 req-79267b37-4312-4625-ab38-7c365452dea6 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f with Priority: HIGHEST for action security_group_members [ 918.139689] env[69920]: INFO networking_nsxv3.common.synchronization [req-52b30179-b4cb-4eb9-878f-7abf4d202934 req-79267b37-4312-4625-ab38-7c365452dea6 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_rules [ 918.139878] env[69920]: INFO networking_nsxv3.common.synchronization [req-52b30179-b4cb-4eb9-878f-7abf4d202934 req-79267b37-4312-4625-ab38-7c365452dea6 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 918.140697] env[69920]: INFO networking_nsxv3.common.synchronization [req-52b30179-b4cb-4eb9-878f-7abf4d202934 req-79267b37-4312-4625-ab38-7c365452dea6 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: 6e95f83c-01f6-4bbe-800b-ed805d60f684 with Priority: HIGHEST for action port [ 918.140697] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f with Priority: HIGHEST for action security_group_rules [ 918.140811] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_rules [ 918.140901] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e95f83c-01f6-4bbe-800b-ed805d60f684 with Priority: HIGHEST for action port [ 918.140992] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f with Priority: HIGHEST for action security_group_members [ 918.141092] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 918.141446] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32db8592-539e-44ed-a2b9-910bd1e0f62f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.141521] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.141576] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.141947] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.142040] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32db8592-539e-44ed-a2b9-910bd1e0f62f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.143836] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.143836] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.143836] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.143836] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.143836] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.148910] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e95f83c-01f6-4bbe-800b-ed805d60f684 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.148910] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e95f83c-01f6-4bbe-800b-ed805d60f684" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.148910] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e95f83c-01f6-4bbe-800b-ed805d60f684" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.148910] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e95f83c-01f6-4bbe-800b-ed805d60f684" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.149859] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e95f83c-01f6-4bbe-800b-ed805d60f684',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.152683] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-32db8592-539e-44ed-a2b9-910bd1e0f62f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.152683] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.152683] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.152683] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.166777] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-159 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.166987] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-159" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.167062] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-159" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.167444] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-159" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.167655] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.167855] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.168061] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.169275] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.169275] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.169416] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 918.169536] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 918.169649] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 918.169761] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 918.169889] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 918.170008] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 918.170154] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 918.191274] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 918.191547] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 918.191777] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 918.192033] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-159" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.192441] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-fa521cbd-9783-45a7-b712-2e14b9bf5139 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.192651] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-fa521cbd-9783-45a7-b712-2e14b9bf5139" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.192834] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-fa521cbd-9783-45a7-b712-2e14b9bf5139" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.193202] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-fa521cbd-9783-45a7-b712-2e14b9bf5139" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.193379] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa521cbd-9783-45a7-b712-2e14b9bf5139',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.524501] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32db8592-539e-44ed-a2b9-910bd1e0f62f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.528551] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.655042] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-32db8592-539e-44ed-a2b9-910bd1e0f62f taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.655042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.655042] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.655042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.655042] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e95f83c-01f6-4bbe-800b-ed805d60f684 with status ACTIVE [ 918.655042] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.655042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.655042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.655042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.655042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.655042] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.655042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.655042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.655042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.655042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.655628] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.655628] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.655923] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.656185] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.656350] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.656516] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e95f83c-01f6-4bbe-800b-ed805d60f684 is going to be updated. [ 918.678885] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.678885] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.678885] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.678885] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.678885] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.678885] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e95f83c-01f6-4bbe-800b-ed805d60f684" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.697040] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.697040] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.697040] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.697040] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.697323] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.699966] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port fa521cbd-9783-45a7-b712-2e14b9bf5139 not found, creating... [ 918.699966] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.699966] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.699966] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.699966] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.699966] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.699966] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.699966] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.699966] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.699966] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.700574] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.700574] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: fa521cbd-9783-45a7-b712-2e14b9bf5139 is going to be created. [ 918.722977] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.723095] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.723263] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.723568] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.723853] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.724120] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-fa521cbd-9783-45a7-b712-2e14b9bf5139" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.027471] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32db8592-539e-44ed-a2b9-910bd1e0f62f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.031117] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.257956] env[69920]: INFO networking_nsxv3.common.synchronization [None req-0a31aadc-f766-4057-98ea-86b30308da59 None None] Enqueued Resource ID: f2f5a64e-7b2b-4d2c-9a02-b90df2ee99c0 with Priority: HIGHEST for action port [ 919.259188] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2f5a64e-7b2b-4d2c-9a02-b90df2ee99c0 with Priority: HIGHEST for action port [ 919.259662] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2f5a64e-7b2b-4d2c-9a02-b90df2ee99c0 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.259834] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2f5a64e-7b2b-4d2c-9a02-b90df2ee99c0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.259929] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2f5a64e-7b2b-4d2c-9a02-b90df2ee99c0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.260273] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2f5a64e-7b2b-4d2c-9a02-b90df2ee99c0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.260387] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2f5a64e-7b2b-4d2c-9a02-b90df2ee99c0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.534207] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.534207] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.534207] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.534207] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.534207] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.534207] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f is going to be created. [ 919.534207] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.534207] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.534207] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.534207] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.534207] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.534207] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 is going to be updated. [ 919.572219] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.572219] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.572219] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.572219] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.572219] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.577042] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.577362] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.577500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.577764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.577972] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.585576] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f in Status: UNINITIALIZED for 2s [ 919.585576] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: IN_PROGRESS for 2s [ 919.765436] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f2f5a64e-7b2b-4d2c-9a02-b90df2ee99c0 [ 919.765664] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.765814] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.765880] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.766128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.766214] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.766310] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f2f5a64e-7b2b-4d2c-9a02-b90df2ee99c0 already deleted. [ 919.766392] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2f5a64e-7b2b-4d2c-9a02-b90df2ee99c0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.981047] env[69920]: INFO networking_nsxv3.common.synchronization [req-d4deab20-5b5c-4283-ab60-41cbaf353a32 req-223c37f4-0a85-4ed2-a2c8-2e5d4556e172 service nova] Enqueued Resource ID: 4d847f61-da82-4a79-82ae-c393059854e9 with Priority: HIGHEST for action security_group_rules [ 919.981047] env[69920]: INFO networking_nsxv3.common.synchronization [req-d4deab20-5b5c-4283-ab60-41cbaf353a32 req-223c37f4-0a85-4ed2-a2c8-2e5d4556e172 service nova] Enqueued Resource ID: 4d847f61-da82-4a79-82ae-c393059854e9 with Priority: HIGHEST for action security_group_members [ 919.981640] env[69920]: INFO networking_nsxv3.common.synchronization [req-d4deab20-5b5c-4283-ab60-41cbaf353a32 req-223c37f4-0a85-4ed2-a2c8-2e5d4556e172 service nova] Enqueued Resource ID: fa521cbd-9783-45a7-b712-2e14b9bf5139 with Priority: HIGHEST for action port [ 919.981750] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d847f61-da82-4a79-82ae-c393059854e9 with Priority: HIGHEST for action security_group_rules [ 919.981857] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d847f61-da82-4a79-82ae-c393059854e9 with Priority: HIGHEST for action security_group_members [ 919.981953] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa521cbd-9783-45a7-b712-2e14b9bf5139 with Priority: HIGHEST for action port [ 919.982359] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d847f61-da82-4a79-82ae-c393059854e9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.983107] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.983107] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.983107] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.983107] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d847f61-da82-4a79-82ae-c393059854e9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.983828] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d847f61-da82-4a79-82ae-c393059854e9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.985233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.985233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.985233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.985233] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.985233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.985233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.985233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.985233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.985233] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d847f61-da82-4a79-82ae-c393059854e9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.986213] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa521cbd-9783-45a7-b712-2e14b9bf5139 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.986213] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa521cbd-9783-45a7-b712-2e14b9bf5139" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.986335] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa521cbd-9783-45a7-b712-2e14b9bf5139" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.986639] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa521cbd-9783-45a7-b712-2e14b9bf5139" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.986760] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa521cbd-9783-45a7-b712-2e14b9bf5139',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.160498] env[69920]: INFO networking_nsxv3.common.synchronization [None req-50c63464-765f-4079-8f06-bc548f85d3ea tempest-ServersTestFqdnHostnames-61407453 tempest-ServersTestFqdnHostnames-61407453-project-member] Enqueued Resource ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 with Priority: HIGHEST for action security_group_rules [ 920.161646] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 with Priority: HIGHEST for action security_group_rules [ 920.161646] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2ff1e5d-d0c8-419d-bc14-18543641dd30 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.161646] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.161646] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.161863] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.162336] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2ff1e5d-d0c8-419d-bc14-18543641dd30',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.331478] env[69920]: INFO networking_nsxv3.common.synchronization [None req-db727b34-fd0e-4068-80e8-351db4effb70 tempest-ServersTestFqdnHostnames-61407453 tempest-ServersTestFqdnHostnames-61407453-project-member] Enqueued Resource ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 with Priority: HIGHEST for action security_group_rules [ 920.332086] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 with Priority: HIGHEST for action security_group_rules [ 920.332515] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2ff1e5d-d0c8-419d-bc14-18543641dd30 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.332648] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.488337] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d847f61-da82-4a79-82ae-c393059854e9 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.488504] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.488642] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4d847f61-da82-4a79-82ae-c393059854e9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.492583] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa521cbd-9783-45a7-b712-2e14b9bf5139 with status ACTIVE [ 920.492860] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.493032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.493137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.493362] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.493456] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.493706] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.493823] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.493895] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.494143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.494233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.494457] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.494558] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.494619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.494793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.494892] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.494992] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa521cbd-9783-45a7-b712-2e14b9bf5139 is going to be updated. [ 920.517651] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.517766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.517819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.518076] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.518253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.518436] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa521cbd-9783-45a7-b712-2e14b9bf5139" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.692487] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.692681] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.693866] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.693866] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.693866] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.693866] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 already deleted. [ 920.693866] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.693866] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.693866] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.693866] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2ff1e5d-d0c8-419d-bc14-18543641dd30',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.993737] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4d847f61-da82-4a79-82ae-c393059854e9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.220605] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.220928] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.220928] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.221210] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.221307] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.221406] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 already deleted. [ 921.221697] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.481047] env[69920]: INFO networking_nsxv3.common.synchronization [None req-b134007f-d1ac-4446-85d3-8594a5ae68bb None None] Enqueued Resource ID: 92d883ea-e6db-47f3-92c8-18584cd27117 with Priority: HIGHEST for action port [ 921.481420] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92d883ea-e6db-47f3-92c8-18584cd27117 with Priority: HIGHEST for action port [ 921.481722] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-92d883ea-e6db-47f3-92c8-18584cd27117 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.481841] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92d883ea-e6db-47f3-92c8-18584cd27117" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.481898] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92d883ea-e6db-47f3-92c8-18584cd27117" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.483591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92d883ea-e6db-47f3-92c8-18584cd27117" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.483685] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92d883ea-e6db-47f3-92c8-18584cd27117',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.495618] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.495771] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.495847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.496094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.496194] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.496284] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d847f61-da82-4a79-82ae-c393059854e9 is going to be created. [ 921.535216] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.535379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.535431] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.535700] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.535905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.549583] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d847f61-da82-4a79-82ae-c393059854e9 in Status: UNINITIALIZED for 2s [ 921.595860] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: SUCCESS [ 921.596120] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.596299] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.596551] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.596741] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.596901] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.596990] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.597195] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.597289] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.597395] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.599559] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f in Status: SUCCESS [ 921.599879] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.599879] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.600021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.600222] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.600321] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.600388] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.600568] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.600620] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.600728] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32db8592-539e-44ed-a2b9-910bd1e0f62f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.694425] env[69920]: INFO networking_nsxv3.common.synchronization [req-3bc77687-439a-4a7b-842c-36f4b7aa726c req-94c71fe2-ed46-42d6-8d34-54364f4e2c83 tempest-ServerRescueTestJSON-1075581336 tempest-ServerRescueTestJSON-1075581336-project-member] Enqueued Resource ID: a6054485-180a-4f29-a65a-3151187db51e with Priority: HIGHEST for action security_group_members [ 921.694984] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6054485-180a-4f29-a65a-3151187db51e with Priority: HIGHEST for action security_group_members [ 921.695313] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6054485-180a-4f29-a65a-3151187db51e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.699019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.699019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.699019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.699019] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.699019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.699019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.699019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.699019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.699019] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6054485-180a-4f29-a65a-3151187db51e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.986215] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92d883ea-e6db-47f3-92c8-18584cd27117 [ 921.986470] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.986617] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.986758] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.986897] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.986982] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.987091] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92d883ea-e6db-47f3-92c8-18584cd27117 already deleted. [ 921.987209] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92d883ea-e6db-47f3-92c8-18584cd27117" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.103936] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.108026] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32db8592-539e-44ed-a2b9-910bd1e0f62f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.202197] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.202318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.202590] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.202590] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.202671] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.202881] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.203084] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.203084] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.203161] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.203258] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.203323] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6054485-180a-4f29-a65a-3151187db51e is going to be updated. [ 922.248782] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.248782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.248782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.248782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.248782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.260749] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6054485-180a-4f29-a65a-3151187db51e in Status: IN_PROGRESS for 2s [ 922.427665] env[69920]: INFO networking_nsxv3.common.synchronization [req-f52a5e84-2743-4da2-b9cf-62e5009c2daf req-08008b5e-92a2-4826-a85c-1975053f3f5a tempest-MultipleCreateTestJSON-1096518746 tempest-MultipleCreateTestJSON-1096518746-project-member] Enqueued Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 922.428311] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 922.428643] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.428766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.428831] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.429049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.429198] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.429291] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.429347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.429496] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.429575] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.429664] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.606523] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.609922] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32db8592-539e-44ed-a2b9-910bd1e0f62f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.806803] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-413 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.807049] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-413" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.807210] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-413" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.807689] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-413" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.807756] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.807877] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.808020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.808302] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.808459] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.808676] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 922.808795] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 922.808908] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 922.809032] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 922.809149] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 922.809258] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 922.809395] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 922.835594] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 922.835859] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 922.836017] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 922.836207] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-413" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.836534] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-e6bbd21d-3bfb-40a1-ab40-d734248c04fb taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.837215] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-e6bbd21d-3bfb-40a1-ab40-d734248c04fb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.837215] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-e6bbd21d-3bfb-40a1-ab40-d734248c04fb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.837338] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-e6bbd21d-3bfb-40a1-ab40-d734248c04fb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.837414] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6bbd21d-3bfb-40a1-ab40-d734248c04fb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.933174] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.933174] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.933174] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.933174] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.933174] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.933174] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.933174] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.933174] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.933174] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.933174] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.933636] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 is going to be deleted. [ 922.966649] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.966649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.966649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.966649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.966649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.966980] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.111044] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.111044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.111044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.111044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.111044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.111044] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 is going to be updated. [ 923.112207] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.112277] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.112386] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.112593] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.112671] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.112765] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f is going to be updated. [ 923.149239] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.149608] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.149608] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.149811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.150082] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.152191] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.152382] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.152595] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.152720] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.152856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.165636] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: IN_PROGRESS for 2s [ 923.168203] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f in Status: IN_PROGRESS for 2s [ 923.339725] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.340053] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.340131] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.340476] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.340639] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.340809] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port e6bbd21d-3bfb-40a1-ab40-d734248c04fb not found, creating... [ 923.341174] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.341397] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.341533] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.341776] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.341927] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.344168] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.344433] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.344584] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.344914] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.345149] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.345353] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: e6bbd21d-3bfb-40a1-ab40-d734248c04fb is going to be created. [ 923.371289] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.371680] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.371864] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.372257] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.372576] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.372902] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-e6bbd21d-3bfb-40a1-ab40-d734248c04fb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.563201] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d847f61-da82-4a79-82ae-c393059854e9 in Status: SUCCESS [ 923.563734] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.563982] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.564312] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.564959] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.564959] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.564959] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.565250] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.565337] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.565492] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.565715] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4d847f61-da82-4a79-82ae-c393059854e9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.068391] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4d847f61-da82-4a79-82ae-c393059854e9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.253938] env[69920]: INFO networking_nsxv3.common.synchronization [req-f52a5e84-2743-4da2-b9cf-62e5009c2daf req-49415fa2-b2f5-4b1c-ae16-d257cd58f990 service nova] Enqueued Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_rules [ 924.253985] env[69920]: INFO networking_nsxv3.common.synchronization [req-f52a5e84-2743-4da2-b9cf-62e5009c2daf req-49415fa2-b2f5-4b1c-ae16-d257cd58f990 service nova] Enqueued Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 924.254132] env[69920]: INFO networking_nsxv3.common.synchronization [req-f52a5e84-2743-4da2-b9cf-62e5009c2daf req-49415fa2-b2f5-4b1c-ae16-d257cd58f990 service nova] Enqueued Resource ID: e6bbd21d-3bfb-40a1-ab40-d734248c04fb with Priority: HIGHEST for action port [ 924.254355] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_rules [ 924.254472] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 924.254563] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6bbd21d-3bfb-40a1-ab40-d734248c04fb with Priority: HIGHEST for action port [ 924.259772] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.259772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.259772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.259772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.259772] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.260070] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.260495] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.260495] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.260495] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.260691] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.261784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.261784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.261784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.261784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.261784] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.263012] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6bbd21d-3bfb-40a1-ab40-d734248c04fb taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.263229] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6bbd21d-3bfb-40a1-ab40-d734248c04fb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.263229] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6bbd21d-3bfb-40a1-ab40-d734248c04fb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.263361] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6bbd21d-3bfb-40a1-ab40-d734248c04fb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.263439] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6bbd21d-3bfb-40a1-ab40-d734248c04fb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.275622] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6054485-180a-4f29-a65a-3151187db51e in Status: SUCCESS [ 924.275844] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6054485-180a-4f29-a65a-3151187db51e deletion is rescheduled due to dependency. [ 924.276289] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6054485-180a-4f29-a65a-3151187db51e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.571409] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4d847f61-da82-4a79-82ae-c393059854e9: rpc.has_security_group_logging(os_id): False [ 924.592148] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.592148] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.592148] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.592148] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.592148] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.592148] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.592148] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.592148] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.592641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.592641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.592641] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d847f61-da82-4a79-82ae-c393059854e9 is going to be created. [ 924.676024] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.676024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.676024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.676024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.676024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.689395] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d847f61-da82-4a79-82ae-c393059854e9 in Status: IN_PROGRESS for 2s [ 924.768800] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.768800] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.768800] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.768800] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e6bbd21d-3bfb-40a1-ab40-d734248c04fb with status ACTIVE [ 924.768800] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.769380] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.769380] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.769380] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.769380] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.769485] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.769574] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.769676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.770156] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.770156] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.770238] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.771046] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.771046] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.771046] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.771046] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.771046] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e6bbd21d-3bfb-40a1-ab40-d734248c04fb is going to be updated. [ 924.800073] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.800073] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.800073] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.800073] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.800073] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.800073] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6bbd21d-3bfb-40a1-ab40-d734248c04fb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.179105] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f in Status: SUCCESS [ 925.179421] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.179671] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.180112] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.180320] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.180505] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.180612] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.180861] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.180998] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.181313] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.181469] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32db8592-539e-44ed-a2b9-910bd1e0f62f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.183651] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: SUCCESS [ 925.183984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.184184] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.184451] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.184721] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.184889] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.185015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.185373] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.185426] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.185525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.185657] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.273142] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.687497] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32db8592-539e-44ed-a2b9-910bd1e0f62f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.688891] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.689082] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.689179] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.689441] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.689647] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.689784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.689877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.690123] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.690245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.690370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.690575] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.690705] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.690793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.690985] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.691895] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.692122] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.692255] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.692485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.692628] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.692776] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.692926] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.717316] env[69920]: INFO networking_nsxv3.common.synchronization [req-92a0b7fc-cf07-496e-a3a7-e7ed55b5ff83 req-bbf65a5b-d6b3-48ec-8a72-e396a4e70522 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f with Priority: HIGHEST for action security_group_members [ 925.721037] env[69920]: INFO networking_nsxv3.common.synchronization [req-92a0b7fc-cf07-496e-a3a7-e7ed55b5ff83 req-bbf65a5b-d6b3-48ec-8a72-e396a4e70522 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 925.721037] env[69920]: INFO networking_nsxv3.common.synchronization [req-92a0b7fc-cf07-496e-a3a7-e7ed55b5ff83 req-bbf65a5b-d6b3-48ec-8a72-e396a4e70522 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: 36b2f83f-91a7-4ec5-ac96-814bcf71bf21 with Priority: HIGHEST for action security_group_members [ 925.721037] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f with Priority: HIGHEST for action security_group_members [ 925.721037] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 925.721037] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36b2f83f-91a7-4ec5-ac96-814bcf71bf21 with Priority: HIGHEST for action security_group_members [ 925.721037] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-32db8592-539e-44ed-a2b9-910bd1e0f62f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.721037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.721037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.721037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.721037] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.721037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.721037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.721037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.721037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.721605] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32db8592-539e-44ed-a2b9-910bd1e0f62f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.722257] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.722360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.722491] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.725583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.725583] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.725583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.725583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.725583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.725583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.725583] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.725583] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-36b2f83f-91a7-4ec5-ac96-814bcf71bf21 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.725583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36b2f83f-91a7-4ec5-ac96-814bcf71bf21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.725583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36b2f83f-91a7-4ec5-ac96-814bcf71bf21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.725583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36b2f83f-91a7-4ec5-ac96-814bcf71bf21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.725583] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.725583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.725583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.725583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.725583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.725583] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36b2f83f-91a7-4ec5-ac96-814bcf71bf21',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.776326] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.776462] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.776534] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.776761] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.776876] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.776976] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 is going to be created. [ 925.780013] env[69920]: INFO networking_nsxv3.common.synchronization [req-92a0b7fc-cf07-496e-a3a7-e7ed55b5ff83 req-bbf65a5b-d6b3-48ec-8a72-e396a4e70522 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f with Priority: HIGHEST for action security_group_rules [ 925.780234] env[69920]: INFO networking_nsxv3.common.synchronization [req-92a0b7fc-cf07-496e-a3a7-e7ed55b5ff83 req-bbf65a5b-d6b3-48ec-8a72-e396a4e70522 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f with Priority: HIGHEST for action security_group_members [ 925.780370] env[69920]: INFO networking_nsxv3.common.synchronization [req-92a0b7fc-cf07-496e-a3a7-e7ed55b5ff83 req-bbf65a5b-d6b3-48ec-8a72-e396a4e70522 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: 36b2f83f-91a7-4ec5-ac96-814bcf71bf21 with Priority: HIGHEST for action security_group_rules [ 925.780501] env[69920]: INFO networking_nsxv3.common.synchronization [req-92a0b7fc-cf07-496e-a3a7-e7ed55b5ff83 req-bbf65a5b-d6b3-48ec-8a72-e396a4e70522 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: 36b2f83f-91a7-4ec5-ac96-814bcf71bf21 with Priority: HIGHEST for action security_group_members [ 925.780628] env[69920]: INFO networking_nsxv3.common.synchronization [req-92a0b7fc-cf07-496e-a3a7-e7ed55b5ff83 req-bbf65a5b-d6b3-48ec-8a72-e396a4e70522 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_rules [ 925.784021] env[69920]: INFO networking_nsxv3.common.synchronization [req-92a0b7fc-cf07-496e-a3a7-e7ed55b5ff83 req-bbf65a5b-d6b3-48ec-8a72-e396a4e70522 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 925.784021] env[69920]: INFO networking_nsxv3.common.synchronization [req-92a0b7fc-cf07-496e-a3a7-e7ed55b5ff83 req-bbf65a5b-d6b3-48ec-8a72-e396a4e70522 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: 6e95f83c-01f6-4bbe-800b-ed805d60f684 with Priority: HIGHEST for action port [ 925.784021] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f with Priority: HIGHEST for action security_group_rules [ 925.784021] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36b2f83f-91a7-4ec5-ac96-814bcf71bf21 with Priority: HIGHEST for action security_group_rules [ 925.784021] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 925.784021] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e95f83c-01f6-4bbe-800b-ed805d60f684 with Priority: HIGHEST for action port [ 925.784021] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_rules [ 925.784021] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f with Priority: HIGHEST for action security_group_members [ 925.784021] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36b2f83f-91a7-4ec5-ac96-814bcf71bf21 with Priority: HIGHEST for action security_group_members [ 925.784021] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32db8592-539e-44ed-a2b9-910bd1e0f62f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.784021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.784021] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-36b2f83f-91a7-4ec5-ac96-814bcf71bf21 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.784021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-36b2f83f-91a7-4ec5-ac96-814bcf71bf21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.784021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-36b2f83f-91a7-4ec5-ac96-814bcf71bf21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.784021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-36b2f83f-91a7-4ec5-ac96-814bcf71bf21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.784021] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('36b2f83f-91a7-4ec5-ac96-814bcf71bf21',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.784773] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.784867] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.785100] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e95f83c-01f6-4bbe-800b-ed805d60f684 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.786891] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e95f83c-01f6-4bbe-800b-ed805d60f684" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.786891] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e95f83c-01f6-4bbe-800b-ed805d60f684" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.786891] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e95f83c-01f6-4bbe-800b-ed805d60f684" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.786891] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e95f83c-01f6-4bbe-800b-ed805d60f684',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.786891] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.786891] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.786891] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-32db8592-539e-44ed-a2b9-910bd1e0f62f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.787254] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.787254] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-36b2f83f-91a7-4ec5-ac96-814bcf71bf21 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.787254] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36b2f83f-91a7-4ec5-ac96-814bcf71bf21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.808566] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.808566] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.809481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.809481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.809481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.842454] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: UNINITIALIZED for 2s [ 926.195299] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32db8592-539e-44ed-a2b9-910bd1e0f62f: rpc.has_security_group_logging(os_id): False [ 926.198046] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e31e2ae5-2f08-403b-b19a-697a36f3cb16: rpc.has_security_group_logging(os_id): False [ 926.221134] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.221134] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.221134] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.221134] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.221134] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.221134] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.221134] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.221134] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.221134] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.221134] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.221134] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f is going to be created. [ 926.226674] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.227650] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.227846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.229770] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.229770] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.229770] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.229770] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.229770] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.229770] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.229770] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.229770] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.229770] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.229770] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.229770] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.229770] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.229770] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.229770] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.230707] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.230974] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.231293] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.231556] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 is going to be updated. [ 926.235854] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('36b2f83f-91a7-4ec5-ac96-814bcf71bf21',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.235854] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.235854] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32db8592-539e-44ed-a2b9-910bd1e0f62f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.288342] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e95f83c-01f6-4bbe-800b-ed805d60f684 with status ACTIVE [ 926.288601] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.288745] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.288824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.289066] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.289163] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.289354] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.289456] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.289519] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.289686] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.289860] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.289943] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.290115] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.290177] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.290276] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.290352] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.290439] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e95f83c-01f6-4bbe-800b-ed805d60f684 is going to be updated. [ 926.293867] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-36b2f83f-91a7-4ec5-ac96-814bcf71bf21 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.294010] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36b2f83f-91a7-4ec5-ac96-814bcf71bf21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.341887] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.342069] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.342069] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.342281] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.342492] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.342692] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e95f83c-01f6-4bbe-800b-ed805d60f684" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.348941] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.349155] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.349155] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.349367] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.349538] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.352997] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.353204] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.353274] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.353489] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.353651] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.368798] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f in Status: IN_PROGRESS for 2s [ 926.375874] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: IN_PROGRESS for 2s [ 926.703786] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d847f61-da82-4a79-82ae-c393059854e9 in Status: SUCCESS [ 926.704060] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.736496] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.737189] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('36b2f83f-91a7-4ec5-ac96-814bcf71bf21',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.738253] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32db8592-539e-44ed-a2b9-910bd1e0f62f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.240762] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.240935] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.241043] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.241260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.241325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.241424] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36b2f83f-91a7-4ec5-ac96-814bcf71bf21 is going to be created. [ 927.242796] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.242919] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.242989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.243196] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.243282] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.243442] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 is going to be updated. [ 927.250129] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.250129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.250129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.250351] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.250351] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.250351] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f is going to be updated. [ 927.283135] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.283296] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.283380] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.286626] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.286626] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.286781] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.286975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.286975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.287210] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.287493] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.299537] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36b2f83f-91a7-4ec5-ac96-814bcf71bf21 in Status: UNINITIALIZED for 2s [ 927.300784] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f in Status: IN_PROGRESS for 2s [ 927.301445] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.301584] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.301656] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.301871] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.302030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.311244] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: IN_PROGRESS for 2s [ 927.854164] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: SUCCESS [ 927.854435] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.854545] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.854759] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.854951] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.855345] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.855345] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.855345] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.855345] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.855535] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.855535] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.359959] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.360128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.360215] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.360445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.360617] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.360717] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.360783] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.360937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.361044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.361136] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.361285] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.361377] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.361437] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.361581] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.361717] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.361809] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.361872] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.362013] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.362096] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.362178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.362268] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.388729] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f in Status: SUCCESS [ 928.388907] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.389079] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.389309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.389400] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32db8592-539e-44ed-a2b9-910bd1e0f62f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.397238] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: SUCCESS [ 928.397517] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.397896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.398216] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.398273] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.865681] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48d70a54-3f5c-40ef-9cc4-f5d82c01a717: rpc.has_security_group_logging(os_id): False [ 928.889173] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.889354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.889445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.889642] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.889762] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.889984] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.890241] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.890241] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.890354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.890429] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.890664] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.890862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.890862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.890944] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.891044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.891260] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.891314] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.891375] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.891649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.891649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.891649] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 is going to be created. [ 928.892972] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-32db8592-539e-44ed-a2b9-910bd1e0f62f taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.893059] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.900653] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.900843] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.955836] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.956021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.956185] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.956309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.956494] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.967968] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: IN_PROGRESS for 2s [ 929.106965] env[69920]: INFO networking_nsxv3.common.synchronization [req-c055b7ac-b1e1-4557-a5d6-971dfc7e4edf req-a2aaa093-6a13-48a8-85f6-2c58c46c3be3 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f with Priority: HIGHEST for action security_group_members [ 929.108111] env[69920]: INFO networking_nsxv3.common.synchronization [req-c055b7ac-b1e1-4557-a5d6-971dfc7e4edf req-a2aaa093-6a13-48a8-85f6-2c58c46c3be3 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 929.108449] env[69920]: INFO networking_nsxv3.common.synchronization [req-c055b7ac-b1e1-4557-a5d6-971dfc7e4edf req-a2aaa093-6a13-48a8-85f6-2c58c46c3be3 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: 36b2f83f-91a7-4ec5-ac96-814bcf71bf21 with Priority: HIGHEST for action security_group_members [ 929.111951] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f with Priority: HIGHEST for action security_group_members [ 929.111951] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 929.111951] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36b2f83f-91a7-4ec5-ac96-814bcf71bf21 with Priority: HIGHEST for action security_group_members [ 929.111951] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-32db8592-539e-44ed-a2b9-910bd1e0f62f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.111951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.111951] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.111951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.111951] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-36b2f83f-91a7-4ec5-ac96-814bcf71bf21 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.111951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-36b2f83f-91a7-4ec5-ac96-814bcf71bf21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.310064] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 36b2f83f-91a7-4ec5-ac96-814bcf71bf21 in Status: SUCCESS [ 929.310948] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36b2f83f-91a7-4ec5-ac96-814bcf71bf21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.310948] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36b2f83f-91a7-4ec5-ac96-814bcf71bf21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.310948] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36b2f83f-91a7-4ec5-ac96-814bcf71bf21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.310948] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.311279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.311279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.311279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.311424] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.311424] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36b2f83f-91a7-4ec5-ac96-814bcf71bf21',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.313689] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f in Status: SUCCESS [ 929.313689] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.314175] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.318025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.318025] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.318025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.318025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.318025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.318025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.318025] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32db8592-539e-44ed-a2b9-910bd1e0f62f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.329675] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: SUCCESS [ 929.329890] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.330881] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.330881] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.330881] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.331165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.331165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.331165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.331355] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.331355] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.819531] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.819696] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.819773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.820009] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.820113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.820315] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.820413] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.820475] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.820636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.820715] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.820804] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36b2f83f-91a7-4ec5-ac96-814bcf71bf21 is going to be deleted. [ 929.821947] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.822074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.822143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.822304] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.822385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.822553] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.822647] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.822710] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.822852] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.822929] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.823261] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f is going to be updated. [ 929.833750] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.861566] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.861768] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.861861] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.862171] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.862301] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.862457] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36b2f83f-91a7-4ec5-ac96-814bcf71bf21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.863056] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36b2f83f-91a7-4ec5-ac96-814bcf71bf21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.863262] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36b2f83f-91a7-4ec5-ac96-814bcf71bf21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.863470] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.863603] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.863682] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.864715] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.864828] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.864953] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36b2f83f-91a7-4ec5-ac96-814bcf71bf21',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.866829] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.867147] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.867147] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.867731] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.867913] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.881394] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f in Status: IN_PROGRESS for 2s [ 930.337673] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.370867] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.370987] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.370987] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.371213] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.371293] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.371622] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.371622] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.371772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.371848] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.371920] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.372029] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36b2f83f-91a7-4ec5-ac96-814bcf71bf21 already deleted. [ 930.372088] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36b2f83f-91a7-4ec5-ac96-814bcf71bf21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.372213] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('36b2f83f-91a7-4ec5-ac96-814bcf71bf21',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.373117] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-36b2f83f-91a7-4ec5-ac96-814bcf71bf21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.373288] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-36b2f83f-91a7-4ec5-ac96-814bcf71bf21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.373441] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.373539] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.373602] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.373741] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.373815] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.374076] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('36b2f83f-91a7-4ec5-ac96-814bcf71bf21',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.840259] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.840588] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.840588] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.840751] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.840844] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.840951] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 is going to be updated. [ 930.875224] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.875535] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.875535] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.875654] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.875875] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.877126] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('36b2f83f-91a7-4ec5-ac96-814bcf71bf21',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.878113] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.878241] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.878312] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.878508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.878592] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.879143] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.879143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.879143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.879143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.879143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.879390] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 36b2f83f-91a7-4ec5-ac96-814bcf71bf21 already deleted. [ 930.879390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-36b2f83f-91a7-4ec5-ac96-814bcf71bf21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.888329] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: IN_PROGRESS for 2s [ 930.984060] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: SUCCESS [ 930.984294] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.380780] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 36b2f83f-91a7-4ec5-ac96-814bcf71bf21: rpc.has_security_group_logging(os_id): False [ 931.400871] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.401146] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.401146] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.401305] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.401403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.401617] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.401738] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.401771] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.401936] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.402000] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.402102] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 36b2f83f-91a7-4ec5-ac96-814bcf71bf21 is going to be created. [ 931.419049] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/36b2f83f-91a7-4ec5-ac96-814bcf71bf21], does not exist path=[/infra/domains/default/groups/36b2f83f-91a7-4ec5-ac96-814bcf71bf21]."\n}' [ 931.419237] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 36b2f83f-91a7-4ec5-ac96-814bcf71bf21 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/36b2f83f-91a7-4ec5-ac96-814bcf71bf21 [ 931.419356] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 931.456819] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.457074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.457074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.457263] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.458380] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.458656] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.458765] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.458832] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.458997] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.459091] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.459286] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.459381] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.459445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.459590] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.459668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.459754] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 36b2f83f-91a7-4ec5-ac96-814bcf71bf21 is going to be created. [ 931.476593] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/36b2f83f-91a7-4ec5-ac96-814bcf71bf21], does not exist path=[/infra/domains/default/groups/36b2f83f-91a7-4ec5-ac96-814bcf71bf21]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/36b2f83f-91a7-4ec5-ac96-814bcf71bf21 [ 931.476745] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-36b2f83f-91a7-4ec5-ac96-814bcf71bf21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.477296] env[69920]: Traceback (most recent call last): [ 931.477344] env[69920]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 931.477344] env[69920]: return func(*args, **kwargs) [ 931.477344] env[69920]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 931.477344] env[69920]: res.raise_for_status() [ 931.477344] env[69920]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 931.477344] env[69920]: raise HTTPError(http_error_msg, response=self) [ 931.477344] env[69920]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/36b2f83f-91a7-4ec5-ac96-814bcf71bf21 [ 931.477344] env[69920]: During handling of the above exception, another exception occurred: [ 931.477344] env[69920]: Traceback (most recent call last): [ 931.477344] env[69920]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 931.477344] env[69920]: listener.cb(fileno) [ 931.477344] env[69920]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 931.477344] env[69920]: result = function(*args, **kwargs) [ 931.477751] env[69920]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 931.477751] env[69920]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 931.477751] env[69920]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 931.477751] env[69920]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 931.477751] env[69920]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 931.477751] env[69920]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 931.477751] env[69920]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 931.477751] env[69920]: res.raise_for_status() [ 931.477751] env[69920]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 931.477751] env[69920]: raise HTTPError(http_error_msg, response=self) [ 931.477751] env[69920]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/36b2f83f-91a7-4ec5-ac96-814bcf71bf21 [ 931.477751] env[69920]: Removing descriptor: 26 [ 931.891191] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f in Status: SUCCESS [ 931.891191] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f deletion is rescheduled due to dependency. [ 931.891191] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.891191] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.891629] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.891629] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.891629] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.891772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.891818] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.891924] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.892054] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.892158] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32db8592-539e-44ed-a2b9-910bd1e0f62f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.893281] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.893281] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.893406] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.893568] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.893568] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.893713] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.893790] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.893892] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32db8592-539e-44ed-a2b9-910bd1e0f62f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.395440] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32db8592-539e-44ed-a2b9-910bd1e0f62f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.397094] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.397242] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.397302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.397580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.418624] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.419040] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.420889] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.420889] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.420889] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.420889] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.420889] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f is going to be updated. [ 932.446829] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.447061] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.447061] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.447756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.447756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.456730] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f in Status: IN_PROGRESS for 2s [ 932.521074] env[69920]: INFO networking_nsxv3.common.synchronization [req-15326ea8-0ee2-4179-b793-4e41f6e9ad55 req-36e8f578-0ee4-440c-baa1-494c1f3b7250 tempest-AttachInterfacesTestJSON-901858583 tempest-AttachInterfacesTestJSON-901858583-project-member] Enqueued Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 932.521625] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 932.521925] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.522063] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.522118] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.522416] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.522510] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.522596] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.522648] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.523990] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.523990] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.523990] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.822240] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.822504] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.822667] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.822935] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.823239] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.823519] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.823670] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.823892] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.824056] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.824272] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 932.824389] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 932.824504] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 932.824654] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 932.824781] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 932.824895] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 932.825046] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 932.844651] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 932.844835] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 932.844981] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 932.845227] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.845568] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-7c2fe55b-b50d-414d-bc2e-984a899ad2e4 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.845742] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-7c2fe55b-b50d-414d-bc2e-984a899ad2e4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.845918] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-7c2fe55b-b50d-414d-bc2e-984a899ad2e4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.846269] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-7c2fe55b-b50d-414d-bc2e-984a899ad2e4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.846416] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c2fe55b-b50d-414d-bc2e-984a899ad2e4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.899665] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: SUCCESS [ 932.899912] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.900207] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32db8592-539e-44ed-a2b9-910bd1e0f62f: rpc.has_security_group_logging(os_id): False [ 932.901172] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.901415] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.901624] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.901770] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.901874] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.902066] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.902182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.902293] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.902437] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.903490] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.903671] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.903850] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.903948] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.904050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.904206] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.904286] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.904375] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.924573] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.924712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.924783] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.924993] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.925100] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.926076] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.926225] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.926294] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.926464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.926984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.927113] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f is going to be updated. [ 932.962355] env[69920]: INFO networking_nsxv3.common.synchronization [None req-fefdd7c9-c8e0-4a4d-9046-e342e5b8bd16 tempest-AttachVolumeNegativeTest-700673554 tempest-AttachVolumeNegativeTest-700673554-project-member] Enqueued Resource ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 with Priority: HIGHEST for action security_group_rules [ 932.962355] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 with Priority: HIGHEST for action security_group_rules [ 932.962355] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1780a9d7-a751-45c5-b020-85c8fdadacd9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.962355] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.962355] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.962858] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.963077] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1780a9d7-a751-45c5-b020-85c8fdadacd9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.989134] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.989134] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.989134] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.989134] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.989134] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.001444] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f in Status: IN_PROGRESS for 2s [ 933.026909] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.026909] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.026909] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.026909] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.026909] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.029528] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.029528] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.029528] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.029528] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.029528] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.029528] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 already deleted. [ 933.029528] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.055397] env[69920]: INFO networking_nsxv3.common.synchronization [None req-c161d99b-da6e-4a5d-8d37-ba9627404532 tempest-AttachVolumeNegativeTest-700673554 tempest-AttachVolumeNegativeTest-700673554-project-member] Enqueued Resource ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 with Priority: HIGHEST for action security_group_rules [ 933.055397] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 with Priority: HIGHEST for action security_group_rules [ 933.058149] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1780a9d7-a751-45c5-b020-85c8fdadacd9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.058149] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.130481] env[69920]: INFO networking_nsxv3.common.synchronization [req-f52a5e84-2743-4da2-b9cf-62e5009c2daf req-887a94cd-90dd-482d-9eca-b2cd0d061f38 tempest-MultipleCreateTestJSON-1096518746 tempest-MultipleCreateTestJSON-1096518746-project-member] Enqueued Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 933.131712] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 933.133017] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.133201] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.133279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.133486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.133645] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.133824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.133894] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.134116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.134152] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.134239] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.351352] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.351762] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.351949] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.352312] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.352515] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.352693] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 7c2fe55b-b50d-414d-bc2e-984a899ad2e4 not found, creating... [ 933.352995] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.353173] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.353292] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.353527] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.353670] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.354554] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.354742] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.354865] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.355113] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.355255] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.355397] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 7c2fe55b-b50d-414d-bc2e-984a899ad2e4 is going to be created. [ 933.379515] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.379800] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.379936] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.380243] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.380483] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.380726] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-7c2fe55b-b50d-414d-bc2e-984a899ad2e4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.407301] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.407301] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.410211] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.495758] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.495758] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.495758] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.495758] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.495758] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.495758] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 already deleted. [ 933.495758] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.495758] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.495758] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.495758] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1780a9d7-a751-45c5-b020-85c8fdadacd9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.564057] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-413 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.564751] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-413" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.564751] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-413" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.564751] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-413" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.564975] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.565160] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.565295] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.565505] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.565730] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.566072] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 933.566321] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 933.566487] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 933.566661] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 933.566798] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 933.566912] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 933.567074] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 933.585032] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 933.585252] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 933.585348] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 933.585529] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-413" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.585933] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-0b58ad52-c0bc-42d5-8d95-358aed165658 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.586206] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-0b58ad52-c0bc-42d5-8d95-358aed165658" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.586318] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-0b58ad52-c0bc-42d5-8d95-358aed165658" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.586816] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-0b58ad52-c0bc-42d5-8d95-358aed165658" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.586816] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b58ad52-c0bc-42d5-8d95-358aed165658',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.637689] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.912448] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.022091] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.022091] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.022091] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.022091] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.022091] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.022352] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 already deleted. [ 934.022352] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.086443] env[69920]: INFO networking_nsxv3.common.synchronization [req-15326ea8-0ee2-4179-b793-4e41f6e9ad55 req-a53eb841-45bd-4a15-ae47-5380d7f8e5ce service nova] Enqueued Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_rules [ 934.086443] env[69920]: INFO networking_nsxv3.common.synchronization [req-15326ea8-0ee2-4179-b793-4e41f6e9ad55 req-a53eb841-45bd-4a15-ae47-5380d7f8e5ce service nova] Enqueued Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 934.086443] env[69920]: INFO networking_nsxv3.common.synchronization [req-15326ea8-0ee2-4179-b793-4e41f6e9ad55 req-a53eb841-45bd-4a15-ae47-5380d7f8e5ce service nova] Enqueued Resource ID: 7c2fe55b-b50d-414d-bc2e-984a899ad2e4 with Priority: HIGHEST for action port [ 934.087974] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_rules [ 934.087974] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 934.087974] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c2fe55b-b50d-414d-bc2e-984a899ad2e4 with Priority: HIGHEST for action port [ 934.087974] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.087974] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.088416] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.088416] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.088525] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.090192] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.090192] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.090192] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.090192] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.090338] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.090338] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.090900] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.091123] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.091396] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.091396] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.092887] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c2fe55b-b50d-414d-bc2e-984a899ad2e4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.092995] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c2fe55b-b50d-414d-bc2e-984a899ad2e4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.093074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c2fe55b-b50d-414d-bc2e-984a899ad2e4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.093237] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c2fe55b-b50d-414d-bc2e-984a899ad2e4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.093311] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c2fe55b-b50d-414d-bc2e-984a899ad2e4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.095217] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.095217] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.095406] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.095493] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.096367] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.096367] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 0b58ad52-c0bc-42d5-8d95-358aed165658 not found, creating... [ 934.096367] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.096367] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.097274] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.097274] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.097274] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.097274] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.097461] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.097597] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.097746] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.097927] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.098100] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 0b58ad52-c0bc-42d5-8d95-358aed165658 is going to be created. [ 934.124017] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.124017] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.124204] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.124395] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.124630] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.124894] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-0b58ad52-c0bc-42d5-8d95-358aed165658" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.140808] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.415110] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.415781] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.415781] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.415781] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.415957] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.416075] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 is going to be updated. [ 934.449388] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.449616] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.449741] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.450086] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.450346] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.465496] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: IN_PROGRESS for 2s [ 934.468507] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f in Status: SUCCESS [ 934.468693] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f deletion is rescheduled due to dependency. [ 934.468811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.593643] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.595290] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.595290] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.601299] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c2fe55b-b50d-414d-bc2e-984a899ad2e4 with status ACTIVE [ 934.601509] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.602015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.602015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.602015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.602140] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.602239] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.602315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.602375] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.602534] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.602608] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.603032] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.603032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.603032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.603178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.603178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.603236] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c2fe55b-b50d-414d-bc2e-984a899ad2e4 is going to be updated. [ 934.626018] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.626351] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.626351] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.626833] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.626833] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.626833] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c2fe55b-b50d-414d-bc2e-984a899ad2e4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.642965] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.643115] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.643180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.643460] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.643980] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.643980] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 is going to be updated. [ 934.677970] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.677970] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.677970] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.677970] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.677970] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.697290] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: IN_PROGRESS for 2s [ 934.954561] env[69920]: INFO networking_nsxv3.common.synchronization [req-f52a5e84-2743-4da2-b9cf-62e5009c2daf req-e0f74b95-34b2-45f6-a5d1-59b8a1f7bc92 service nova] Enqueued Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_rules [ 934.954561] env[69920]: INFO networking_nsxv3.common.synchronization [req-f52a5e84-2743-4da2-b9cf-62e5009c2daf req-e0f74b95-34b2-45f6-a5d1-59b8a1f7bc92 service nova] Enqueued Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 934.954561] env[69920]: INFO networking_nsxv3.common.synchronization [req-f52a5e84-2743-4da2-b9cf-62e5009c2daf req-e0f74b95-34b2-45f6-a5d1-59b8a1f7bc92 service nova] Enqueued Resource ID: 0b58ad52-c0bc-42d5-8d95-358aed165658 with Priority: HIGHEST for action port [ 934.954561] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_rules [ 934.954561] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 934.954561] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b58ad52-c0bc-42d5-8d95-358aed165658 with Priority: HIGHEST for action port [ 934.955485] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.955578] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.955610] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.956108] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.956108] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.957573] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.957672] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.958146] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b58ad52-c0bc-42d5-8d95-358aed165658 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.958146] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b58ad52-c0bc-42d5-8d95-358aed165658" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.958146] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b58ad52-c0bc-42d5-8d95-358aed165658" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.958315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b58ad52-c0bc-42d5-8d95-358aed165658" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.959415] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b58ad52-c0bc-42d5-8d95-358aed165658',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.019193] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f in Status: SUCCESS [ 935.019193] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.096241] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.462164] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.462340] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.463609] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b58ad52-c0bc-42d5-8d95-358aed165658 with status ACTIVE [ 935.463804] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.463920] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.463984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.464203] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.464289] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.464448] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.464539] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.464596] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.464746] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.464819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.465026] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.465122] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.465180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.465320] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.465389] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.465469] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b58ad52-c0bc-42d5-8d95-358aed165658 is going to be updated. [ 935.486346] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.486346] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.486458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.489020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.489020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.489020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b58ad52-c0bc-42d5-8d95-358aed165658" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.598957] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.599183] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.599231] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.599478] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.599573] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.599679] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 is going to be created. [ 935.636601] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.636852] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.636975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.637252] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.637453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.649274] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: UNINITIALIZED for 2s [ 936.475642] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: SUCCESS [ 936.476030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.476200] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.476327] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.476515] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.477360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.477360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.477360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.477360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.477360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.477360] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.477360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.477360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.477653] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.477653] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.477653] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.477762] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.477831] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.477904] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.478821] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.478821] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.708038] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: SUCCESS [ 936.708214] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.708439] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.708685] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.709021] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.709441] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.709441] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.709441] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.709575] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.709648] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.980330] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e31e2ae5-2f08-403b-b19a-697a36f3cb16: rpc.has_security_group_logging(os_id): False [ 937.001773] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.001959] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.002063] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.002282] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.027548] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.027821] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.027961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.028054] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.028388] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.028388] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.028608] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.028730] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.028815] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.028950] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.029040] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.029262] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.029359] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.029433] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.029594] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.029703] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.029813] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 is going to be updated. [ 937.110920] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.111174] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.111293] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.111627] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.111872] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.134438] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: IN_PROGRESS for 2s [ 937.213207] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.659880] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: SUCCESS [ 937.660139] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.660345] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.660521] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.660715] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.660835] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.660914] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.661074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.661156] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.661238] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.661328] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.715345] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.164929] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.165116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.165165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.165386] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.165552] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.165656] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.165720] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.165889] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.165986] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.166092] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.166244] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.166339] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.166407] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.166548] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.166759] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.166861] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.166932] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.167114] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.167195] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.167309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.167404] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.220684] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.220684] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.220684] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.220684] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.220684] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.220684] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 is going to be updated. [ 938.260131] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.260131] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.260131] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.260131] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.260131] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.270536] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: IN_PROGRESS for 2s [ 938.671792] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a9f1a73-f43f-451c-8ce2-328d0b73b769: rpc.has_security_group_logging(os_id): False [ 938.691192] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.691367] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.691424] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.691637] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.691727] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.691934] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.692109] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.692566] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.692566] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.692566] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.692758] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.692758] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.692758] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.692908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.692962] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.694260] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.694375] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.694446] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.694601] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.694939] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.694939] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 is going to be created. [ 938.777273] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.777497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.777497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.777728] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.777912] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.790318] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: IN_PROGRESS for 2s [ 939.163806] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: SUCCESS [ 939.164273] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.954951] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 939.955290] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 940.166180] env[69920]: INFO networking_nsxv3.common.synchronization [req-b376eea2-4019-429c-bead-04bfb5afe9d4 req-f359cb7c-6393-4f34-b674-53127b3158dc tempest-ImagesOneServerNegativeTestJSON-924528592 tempest-ImagesOneServerNegativeTestJSON-924528592-project-member] Enqueued Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_members [ 940.166180] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_members [ 940.166180] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.166180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.166180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.166180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.166180] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.166180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.166180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.166180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.166180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.166180] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.292026] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: SUCCESS [ 940.292117] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.292938] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.292938] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.293082] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.293199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.293255] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.293443] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.293550] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.293602] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.293690] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.644023] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-444 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.644023] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-444" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.644023] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-444" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.644475] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-444" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.644475] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.644658] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.644778] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.645119] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.645291] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.645519] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 940.645656] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 940.645774] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 940.645958] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 940.646149] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 940.646293] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 940.646437] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 940.667031] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 940.667031] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 940.667521] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 940.667869] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-444" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.669327] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-0d5e4812-8ef2-4a9f-92e9-29113e1eb77e taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.669327] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-0d5e4812-8ef2-4a9f-92e9-29113e1eb77e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.669327] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-0d5e4812-8ef2-4a9f-92e9-29113e1eb77e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.669579] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-0d5e4812-8ef2-4a9f-92e9-29113e1eb77e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.669835] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d5e4812-8ef2-4a9f-92e9-29113e1eb77e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.671536] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.672559] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.672559] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.674172] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.697501] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.700039] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.700039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.700039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.700039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.700039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.700039] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb is going to be updated. [ 940.729558] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.729558] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.729816] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.729846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.729979] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.739861] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb in Status: IN_PROGRESS for 2s [ 940.799520] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.799668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.799802] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.799952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.800126] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.800242] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.800323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.800483] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.800566] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.800652] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.801236] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.801236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.801236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.801236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.801236] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.802960] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.802960] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.802960] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.802960] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.802960] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.802960] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.804864] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: SUCCESS [ 940.805115] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.177243] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.177549] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.177626] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.178527] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.178527] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.179274] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 0d5e4812-8ef2-4a9f-92e9-29113e1eb77e not found, creating... [ 941.179843] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.180668] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.180842] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.181147] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.181308] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.181637] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.181809] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.181932] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.182187] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.182362] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.183055] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 0d5e4812-8ef2-4a9f-92e9-29113e1eb77e is going to be created. [ 941.215694] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.216061] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.216234] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.216616] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.216990] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.217268] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-0d5e4812-8ef2-4a9f-92e9-29113e1eb77e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.305065] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48d70a54-3f5c-40ef-9cc4-f5d82c01a717: rpc.has_security_group_logging(os_id): False [ 941.332362] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.332362] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.332362] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.332557] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.367711] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.367711] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.367711] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.367711] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.367711] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.367711] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.367711] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.367711] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.368406] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.368406] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.368406] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.368406] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.368406] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.368406] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.368406] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.368727] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.368727] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 is going to be updated. [ 941.471775] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.471775] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.471775] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.472116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.472116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.490508] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: IN_PROGRESS for 2s [ 942.358855] env[69920]: INFO networking_nsxv3.common.synchronization [req-b376eea2-4019-429c-bead-04bfb5afe9d4 req-ffc0273b-1d0e-47d5-bacd-9c6ae4e558ae service nova] Enqueued Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_rules [ 942.359170] env[69920]: INFO networking_nsxv3.common.synchronization [req-b376eea2-4019-429c-bead-04bfb5afe9d4 req-ffc0273b-1d0e-47d5-bacd-9c6ae4e558ae service nova] Enqueued Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_members [ 942.359209] env[69920]: INFO networking_nsxv3.common.synchronization [req-b376eea2-4019-429c-bead-04bfb5afe9d4 req-ffc0273b-1d0e-47d5-bacd-9c6ae4e558ae service nova] Enqueued Resource ID: 0d5e4812-8ef2-4a9f-92e9-29113e1eb77e with Priority: HIGHEST for action port [ 942.359424] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_rules [ 942.359553] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_members [ 942.359651] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d5e4812-8ef2-4a9f-92e9-29113e1eb77e with Priority: HIGHEST for action port [ 942.360373] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f8bd1f0-245d-4d6b-8841-4e7773984ffb taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.360597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.360718] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.361035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.361158] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.363496] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.363598] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.364132] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d5e4812-8ef2-4a9f-92e9-29113e1eb77e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.364132] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d5e4812-8ef2-4a9f-92e9-29113e1eb77e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.364132] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d5e4812-8ef2-4a9f-92e9-29113e1eb77e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.364295] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d5e4812-8ef2-4a9f-92e9-29113e1eb77e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.364357] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d5e4812-8ef2-4a9f-92e9-29113e1eb77e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.749494] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb in Status: SUCCESS [ 942.749750] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb deletion is rescheduled due to dependency. [ 942.749864] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.750129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.750342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.750529] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.750711] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.750792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.750945] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.751083] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.751168] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.865944] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.866114] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.866324] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d5e4812-8ef2-4a9f-92e9-29113e1eb77e with status ACTIVE [ 942.867111] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.867111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.867111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.867111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.867111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.867315] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.867315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.867315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.867556] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.867556] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.867697] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.867802] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.867881] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.868053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.868151] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.868209] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d5e4812-8ef2-4a9f-92e9-29113e1eb77e is going to be updated. [ 942.905019] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.905257] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.905335] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.905668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.905835] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.906168] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d5e4812-8ef2-4a9f-92e9-29113e1eb77e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.254455] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.445978] env[69920]: INFO networking_nsxv3.common.synchronization [None req-2ff3c26e-6bbd-442d-aaca-f5d7f63ca373 None None] Enqueued Resource ID: 785b894d-cb6d-48c9-8756-330bf2130f94 with Priority: HIGHEST for action port [ 943.446327] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 785b894d-cb6d-48c9-8756-330bf2130f94 with Priority: HIGHEST for action port [ 943.446826] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-785b894d-cb6d-48c9-8756-330bf2130f94 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.446958] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-785b894d-cb6d-48c9-8756-330bf2130f94" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.447058] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-785b894d-cb6d-48c9-8756-330bf2130f94" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.447322] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-785b894d-cb6d-48c9-8756-330bf2130f94" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.447400] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('785b894d-cb6d-48c9-8756-330bf2130f94',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.508691] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: SUCCESS [ 943.509277] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.763017] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.953028] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 785b894d-cb6d-48c9-8756-330bf2130f94 [ 943.953424] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.953724] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.953846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.954123] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.955222] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.955222] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:785b894d-cb6d-48c9-8756-330bf2130f94 already deleted. [ 943.955222] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-785b894d-cb6d-48c9-8756-330bf2130f94" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.076867] env[69920]: INFO networking_nsxv3.common.synchronization [req-db4b51d2-6987-4ee8-b489-1abc09eda9cc req-6e51363f-53a0-4462-8e1b-7616c09faf2e tempest-ImagesTestJSON-210893687 tempest-ImagesTestJSON-210893687-project-member] Enqueued Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 944.077429] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 944.079009] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.079148] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.079223] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.079457] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.079606] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.079713] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.079777] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.080356] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.080356] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.080356] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.265228] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.266157] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.266157] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.266157] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.266157] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.266157] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb is going to be updated. [ 944.296301] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.296446] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.296512] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.296714] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.296908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.305975] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb in Status: IN_PROGRESS for 2s [ 944.488303] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-203 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.488303] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-203" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.488303] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-203" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.488303] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-203" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.490090] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.490337] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.490463] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.490754] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.490921] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.491153] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 944.491268] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 944.491376] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 944.491484] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 944.491612] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 944.491749] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 944.491892] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 944.521885] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 944.522111] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 944.522265] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 944.522452] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-203" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.522780] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-0780f226-29c3-4879-8d9c-5dfd33960929 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.522987] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-0780f226-29c3-4879-8d9c-5dfd33960929" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.523618] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-0780f226-29c3-4879-8d9c-5dfd33960929" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.523618] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-0780f226-29c3-4879-8d9c-5dfd33960929" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.523618] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0780f226-29c3-4879-8d9c-5dfd33960929',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.583418] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.584242] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.584242] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.586488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.608925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.609224] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.609359] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.609431] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.609766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.609766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.609859] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 is going to be updated. [ 944.641072] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.641072] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.641072] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.641072] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.641072] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.652523] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: IN_PROGRESS for 2s [ 944.877521] env[69920]: INFO networking_nsxv3.common.synchronization [None req-4f58efd6-7cd4-47c8-b812-980008051bf9 tempest-ServerActionsTestOtherB-54229569 tempest-ServerActionsTestOtherB-54229569-project-member] Enqueued Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_rules [ 944.877950] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_rules [ 944.878995] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.879166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.879241] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.879501] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.879595] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.030383] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.030563] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.030732] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.031036] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.031216] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.031383] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 0780f226-29c3-4879-8d9c-5dfd33960929 not found, creating... [ 945.031665] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.031828] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.031952] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.032513] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.032513] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.032653] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.032812] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.032936] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.038948] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.039186] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.039356] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 0780f226-29c3-4879-8d9c-5dfd33960929 is going to be created. [ 945.065408] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.065658] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.065751] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.067134] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.068324] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.068670] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-0780f226-29c3-4879-8d9c-5dfd33960929" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.105772] env[69920]: INFO networking_nsxv3.common.synchronization [None req-d10ae001-84fd-44a1-a8e6-0272b120a3f5 tempest-ServerActionsTestOtherB-54229569 tempest-ServerActionsTestOtherB-54229569-project-member] Enqueued Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_rules [ 945.107310] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_rules [ 945.107623] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.107721] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.403363] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.403363] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.403363] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.403642] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.403642] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.403642] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b already deleted. [ 945.405561] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.405764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.405993] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.406099] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.486755] env[69920]: INFO networking_nsxv3.common.synchronization [None req-0eb725ce-9722-4270-86c4-35e78abb6882 None None] Enqueued Resource ID: 7ffa62ed-f1e8-4862-a752-a020e02a852a with Priority: HIGHEST for action port [ 945.487326] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ffa62ed-f1e8-4862-a752-a020e02a852a with Priority: HIGHEST for action port [ 945.488062] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ffa62ed-f1e8-4862-a752-a020e02a852a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.488062] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ffa62ed-f1e8-4862-a752-a020e02a852a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.488062] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ffa62ed-f1e8-4862-a752-a020e02a852a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.488236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ffa62ed-f1e8-4862-a752-a020e02a852a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.488236] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ffa62ed-f1e8-4862-a752-a020e02a852a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.805235] env[69920]: INFO networking_nsxv3.common.synchronization [req-db4b51d2-6987-4ee8-b489-1abc09eda9cc req-2e27c03e-765d-4b5d-81db-74e2e4e6961c service nova] Enqueued Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_rules [ 945.805235] env[69920]: INFO networking_nsxv3.common.synchronization [req-db4b51d2-6987-4ee8-b489-1abc09eda9cc req-2e27c03e-765d-4b5d-81db-74e2e4e6961c service nova] Enqueued Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 945.805235] env[69920]: INFO networking_nsxv3.common.synchronization [req-db4b51d2-6987-4ee8-b489-1abc09eda9cc req-2e27c03e-765d-4b5d-81db-74e2e4e6961c service nova] Enqueued Resource ID: 0780f226-29c3-4879-8d9c-5dfd33960929 with Priority: HIGHEST for action port [ 945.805235] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_rules [ 945.805235] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 945.805235] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0780f226-29c3-4879-8d9c-5dfd33960929 with Priority: HIGHEST for action port [ 945.806654] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.806946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.807773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.808778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.808778] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.812283] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.812377] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.812672] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-0780f226-29c3-4879-8d9c-5dfd33960929 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.812672] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0780f226-29c3-4879-8d9c-5dfd33960929" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.812785] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0780f226-29c3-4879-8d9c-5dfd33960929" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.812912] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0780f226-29c3-4879-8d9c-5dfd33960929" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.812989] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0780f226-29c3-4879-8d9c-5dfd33960929',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.925334] env[69920]: INFO networking_nsxv3.common.synchronization [req-6f38a2ee-14c2-421f-9de7-574ea5ed011c req-f514588d-0d35-4e5b-b82a-aea9fbb24703 tempest-MultipleCreateTestJSON-1096518746 tempest-MultipleCreateTestJSON-1096518746-project-member] Enqueued Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 945.925540] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 945.926714] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.926839] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.926939] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.927135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.927220] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.927310] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b already deleted. [ 945.927388] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.927633] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.927733] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.927792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.927953] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.928112] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.928220] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.928304] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.931345] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.931345] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.931345] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.991725] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ffa62ed-f1e8-4862-a752-a020e02a852a [ 945.991725] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.991725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.991725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.991725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.991725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.991725] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ffa62ed-f1e8-4862-a752-a020e02a852a already deleted. [ 945.991725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ffa62ed-f1e8-4862-a752-a020e02a852a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.094181] env[69920]: INFO networking_nsxv3.common.synchronization [req-890720cb-6e34-4e00-919d-c6586d904c05 req-ccd52ad5-053f-457d-ac91-6d9ad7380096 tempest-MultipleCreateTestJSON-1096518746 tempest-MultipleCreateTestJSON-1096518746-project-member] Enqueued Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 946.094181] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGHEST for action security_group_members [ 946.094181] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.094181] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.315489] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0780f226-29c3-4879-8d9c-5dfd33960929 with status ACTIVE [ 946.315794] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.317464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.317464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.317464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.317464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.317464] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.317464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.317464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.317464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.317464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.317464] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.317464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.317464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.317932] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.317932] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.317932] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0780f226-29c3-4879-8d9c-5dfd33960929 is going to be updated. [ 946.320190] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.320334] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.321536] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb in Status: SUCCESS [ 946.321769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.322152] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.322227] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.322349] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.322455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.322521] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.322678] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.322764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.322849] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.322941] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.348791] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.348962] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.349063] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.349245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.349536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.349536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0780f226-29c3-4879-8d9c-5dfd33960929" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.435471] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.665354] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: SUCCESS [ 946.665487] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 deletion is rescheduled due to dependency. [ 946.665611] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.665775] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.666376] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.666376] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.666376] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.666376] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.666612] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.666612] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.666725] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.825838] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.826246] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.826246] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.826899] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.826899] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.826899] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.826899] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.826899] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.826899] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.827154] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.827154] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.827231] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.827280] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.827429] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.827571] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.827662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.827721] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.827861] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.827937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.828032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.828125] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.939120] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.171545] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.333440] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f8bd1f0-245d-4d6b-8841-4e7773984ffb: rpc.has_security_group_logging(os_id): False [ 947.354050] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.354231] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.354335] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.354526] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.354617] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.354839] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.354942] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.355013] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.355175] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.355253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.355480] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.355588] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.355653] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.355798] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.355871] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.356091] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.356319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.356319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.356444] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.356444] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.356528] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb is going to be updated. [ 947.421591] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.421804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.421804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.421998] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.422213] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.438859] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb in Status: IN_PROGRESS for 2s [ 947.441126] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.441284] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.441328] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.441560] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.441770] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.441770] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 is going to be updated. [ 947.482211] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.482422] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.482422] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.482638] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.482779] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.493449] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: IN_PROGRESS for 2s [ 947.546516] env[69920]: INFO networking_nsxv3.common.synchronization [req-a5fe15d3-07e3-4c6c-8d84-c0c4ba9ca047 req-ff4b157f-bddb-4b4b-a4ec-05e2e8df778a tempest-AttachInterfacesTestJSON-901858583 tempest-AttachInterfacesTestJSON-901858583-project-member] Enqueued Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 947.547252] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 947.547649] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.547819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.547919] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.548200] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.548388] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.548529] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.548623] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.548823] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.548949] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.549089] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.674978] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.052183] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.052527] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.052527] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.052640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.052734] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.052940] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.053074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.053165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.053328] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.053413] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.053530] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 is going to be updated. [ 948.089689] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.089689] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.089789] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.089984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.090172] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.100703] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: IN_PROGRESS for 2s [ 948.177047] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.177341] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.177341] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.177780] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.177780] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.177885] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 is going to be updated. [ 948.250278] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.250417] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.250484] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.251118] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.251118] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.266271] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: IN_PROGRESS for 2s [ 949.453499] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb in Status: SUCCESS [ 949.453748] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.506961] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: SUCCESS [ 949.507227] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.507414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.508019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.508252] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.508378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.508443] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.508627] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.509050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.509162] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.014144] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.014358] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.014405] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.014605] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.014700] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.014898] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.014996] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.015085] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.015237] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.015326] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.015430] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 is going to be updated. [ 950.044418] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.044418] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.044418] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.044418] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.044418] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.057385] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: IN_PROGRESS for 2s [ 950.112062] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: SUCCESS [ 950.112261] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 deletion is rescheduled due to dependency. [ 950.112377] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.277921] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: SUCCESS [ 950.278215] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.278441] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.278663] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.278849] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.278966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.279047] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.279207] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.279289] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.279376] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.279478] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.783079] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.783381] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.783381] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.783570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.783712] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.784259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.784259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.784259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.784259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.784491] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.784491] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.784607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.784746] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.784809] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.784929] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.787228] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.787407] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.787470] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.787564] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.787655] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.787753] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.084709] env[69920]: INFO networking_nsxv3.common.synchronization [None req-03904da1-c4fd-4ba9-be48-a97aa10ccc56 tempest-AttachVolumeTestJSON-218421131 tempest-AttachVolumeTestJSON-218421131-project-member] Enqueued Resource ID: 225fb705-337d-4abe-9a25-de3a33d5a961 with Priority: HIGHEST for action security_group_rules [ 951.084709] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 225fb705-337d-4abe-9a25-de3a33d5a961 with Priority: HIGHEST for action security_group_rules [ 951.084709] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-225fb705-337d-4abe-9a25-de3a33d5a961 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.084709] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.084709] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.084709] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.084709] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('225fb705-337d-4abe-9a25-de3a33d5a961',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.159292] env[69920]: INFO networking_nsxv3.common.synchronization [None req-edee1469-2600-4049-b77e-c0d499163614 tempest-AttachVolumeTestJSON-218421131 tempest-AttachVolumeTestJSON-218421131-project-member] Enqueued Resource ID: 225fb705-337d-4abe-9a25-de3a33d5a961 with Priority: HIGHEST for action security_group_rules [ 951.160190] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 225fb705-337d-4abe-9a25-de3a33d5a961 with Priority: HIGHEST for action security_group_rules [ 951.160571] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-225fb705-337d-4abe-9a25-de3a33d5a961 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.160692] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.292902] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1712776d-764c-405e-85d0-105070b4c2e8: rpc.has_security_group_logging(os_id): False [ 951.316591] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.316858] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.316858] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.317119] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.317256] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.317511] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.317641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.317732] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.317912] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.318031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.318240] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.318361] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.318442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.318591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.318675] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.318905] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.319012] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.321260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.321645] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.321794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.321912] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 is going to be updated. [ 951.390985] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.391508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.391508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.391508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.391648] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.408020] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: IN_PROGRESS for 2s [ 951.611098] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.611295] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.611357] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.611618] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.611723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.612660] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 225fb705-337d-4abe-9a25-de3a33d5a961 already deleted. [ 951.612660] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.612660] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.612660] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.612660] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('225fb705-337d-4abe-9a25-de3a33d5a961',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.649097] env[69920]: INFO networking_nsxv3.common.synchronization [req-d138d717-00ab-493e-92a2-1a6c3c034f24 req-f1195bb8-088e-4ada-b007-018e68bbb3c8 tempest-AttachInterfacesTestJSON-901858583 tempest-AttachInterfacesTestJSON-901858583-project-member] Enqueued Resource ID: 82051f94-9eeb-470d-aa42-9e827049069f with Priority: HIGHEST for action security_group_members [ 951.649783] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82051f94-9eeb-470d-aa42-9e827049069f with Priority: HIGHEST for action security_group_members [ 951.650107] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-82051f94-9eeb-470d-aa42-9e827049069f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.650226] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.650291] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.650499] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.650646] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.650740] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.650805] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.650943] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.652476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.653573] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82051f94-9eeb-470d-aa42-9e827049069f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.069770] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 in Status: SUCCESS [ 952.069770] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 deletion is rescheduled due to dependency. [ 952.069770] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.156296] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.156581] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.156686] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.157037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.235801] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.236030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.239848] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.239848] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.240012] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.240012] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.240217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.240319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.240419] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82051f94-9eeb-470d-aa42-9e827049069f is going to be updated. [ 952.241896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.241896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.241896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.241896] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 225fb705-337d-4abe-9a25-de3a33d5a961 already deleted. [ 952.241896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.273183] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.273183] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.273183] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.273183] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.273831] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.284436] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82051f94-9eeb-470d-aa42-9e827049069f in Status: IN_PROGRESS for 2s [ 953.421026] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: SUCCESS [ 953.421026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.299044] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82051f94-9eeb-470d-aa42-9e827049069f in Status: SUCCESS [ 954.299765] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82051f94-9eeb-470d-aa42-9e827049069f deletion is rescheduled due to dependency. [ 954.299765] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.473383] env[69920]: INFO networking_nsxv3.common.synchronization [req-f31b36d3-b49b-4d9b-9621-34810fb327b8 req-5295258d-10b8-4e06-bda7-9e8a4759ae62 tempest-ServerDiskConfigTestJSON-714416826 tempest-ServerDiskConfigTestJSON-714416826-project-member] Enqueued Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 956.474370] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 956.474748] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.474856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.474856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.475111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.475296] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.475417] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.475479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.475681] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.475771] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.475858] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.979289] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.979538] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.979700] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.979971] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.005864] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.005864] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.005864] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.005864] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.006228] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.006276] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.006403] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 is going to be updated. [ 957.037444] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.037784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.037784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.038180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.038228] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.047961] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: IN_PROGRESS for 2s [ 957.090452] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-538 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.090651] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-538" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.091241] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-538" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.091241] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-538" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.092072] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.092305] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.092440] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.092772] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.092981] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.093314] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.093516] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 957.093691] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 957.093864] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 957.094041] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.094168] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 957.094312] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 957.114993] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 957.115221] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 957.115369] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 957.115552] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-538" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.115926] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-fc4d69e0-0a53-4c34-8f56-6416a884b018 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.116077] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-fc4d69e0-0a53-4c34-8f56-6416a884b018" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.116214] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-fc4d69e0-0a53-4c34-8f56-6416a884b018" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.116638] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-fc4d69e0-0a53-4c34-8f56-6416a884b018" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.116807] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc4d69e0-0a53-4c34-8f56-6416a884b018',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.626639] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.626975] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.627108] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.627344] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.627545] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.627731] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port fc4d69e0-0a53-4c34-8f56-6416a884b018 not found, creating... [ 957.628019] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.628186] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.628390] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.628617] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.628766] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.629066] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.629231] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.629351] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.629561] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.629699] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.629842] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: fc4d69e0-0a53-4c34-8f56-6416a884b018 is going to be created. [ 957.648688] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.648907] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.649067] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.649406] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.649648] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.649878] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-fc4d69e0-0a53-4c34-8f56-6416a884b018" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.656124] env[69920]: INFO networking_nsxv3.common.synchronization [req-f31b36d3-b49b-4d9b-9621-34810fb327b8 req-c4f60cfe-4a8e-4ad4-a436-01fd926b0a68 service nova] Enqueued Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_rules [ 958.656124] env[69920]: INFO networking_nsxv3.common.synchronization [req-f31b36d3-b49b-4d9b-9621-34810fb327b8 req-c4f60cfe-4a8e-4ad4-a436-01fd926b0a68 service nova] Enqueued Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 958.656124] env[69920]: INFO networking_nsxv3.common.synchronization [req-f31b36d3-b49b-4d9b-9621-34810fb327b8 req-c4f60cfe-4a8e-4ad4-a436-01fd926b0a68 service nova] Enqueued Resource ID: fc4d69e0-0a53-4c34-8f56-6416a884b018 with Priority: HIGHEST for action port [ 958.656836] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_rules [ 958.657195] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 958.657517] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4d69e0-0a53-4c34-8f56-6416a884b018 with Priority: HIGHEST for action port [ 958.658206] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.658529] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.658788] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.659102] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.659297] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.661129] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.661129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.661129] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc4d69e0-0a53-4c34-8f56-6416a884b018 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.661129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc4d69e0-0a53-4c34-8f56-6416a884b018" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.661129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc4d69e0-0a53-4c34-8f56-6416a884b018" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.661129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc4d69e0-0a53-4c34-8f56-6416a884b018" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.661683] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc4d69e0-0a53-4c34-8f56-6416a884b018',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.063406] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: SUCCESS [ 959.063709] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 deletion is rescheduled due to dependency. [ 959.063884] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.064219] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.064501] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.064778] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.064973] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.067766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.068405] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.068557] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.068935] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.167555] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.167716] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.167878] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc4d69e0-0a53-4c34-8f56-6416a884b018 with status ACTIVE [ 959.169123] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.169301] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.169373] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.169675] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.169846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.170074] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.170196] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.170267] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.170445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.170529] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.170722] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.170817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.170880] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.171110] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.171226] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.171322] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc4d69e0-0a53-4c34-8f56-6416a884b018 is going to be updated. [ 959.198292] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.198515] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.198603] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.198770] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.198928] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.199133] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc4d69e0-0a53-4c34-8f56-6416a884b018" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.571905] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.078247] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.580565] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.581839] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.581839] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.581999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.582143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.582267] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 is going to be updated. [ 960.623050] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.623050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.623050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.623281] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.623383] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.633504] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: IN_PROGRESS for 2s [ 962.650867] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: SUCCESS [ 962.650867] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.652258] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.653025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.653025] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.653182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.653182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.653514] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.653514] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.654257] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.654257] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.158122] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.158122] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.158122] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.158122] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.158122] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.158122] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.158122] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.158122] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.158122] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.158122] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.158650] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.158650] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.158650] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.158650] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.158650] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.158815] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.158815] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.158970] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.159119] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.159243] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.159354] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.658984] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 963.659203] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 963.663595] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7eba410e-a0d6-4873-9363-054f457d21d4: rpc.has_security_group_logging(os_id): False [ 963.685128] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.685128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.685128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.685128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.685128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.685128] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.685624] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.685624] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.685624] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.685624] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.685828] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.685895] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.686143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.686143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.686334] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.686456] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.686597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.686676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.686854] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.686934] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.689516] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 is going to be updated. [ 963.764293] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.764553] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.764553] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.764819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.764942] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.789257] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: IN_PROGRESS for 2s [ 965.809721] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: SUCCESS [ 965.810540] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.153693] env[69920]: INFO networking_nsxv3.common.synchronization [req-05bffbec-c902-4a3f-a33f-66a4dc971bcf req-9484067d-c08a-46df-80f3-8321a24f4a3f tempest-ImagesOneServerNegativeTestJSON-924528592 tempest-ImagesOneServerNegativeTestJSON-924528592-project-member] Enqueued Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_members [ 966.155512] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_members [ 966.155512] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.155512] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.155512] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.155512] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.155512] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.155512] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.155512] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.155802] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.155802] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.155802] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.658381] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.658552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.658613] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.658836] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.658931] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.659171] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.659287] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.659344] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.659506] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.659919] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.659919] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb is going to be updated. [ 966.688579] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.688771] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.688771] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.688961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.689136] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.700919] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb in Status: IN_PROGRESS for 2s [ 968.446091] env[69920]: INFO networking_nsxv3.common.synchronization [None req-2c2db077-9d2a-4376-a450-fabbf2681420 None None] Enqueued Resource ID: 67c3b336-2363-461c-acad-86a2342a622b with Priority: HIGHEST for action port [ 968.447196] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67c3b336-2363-461c-acad-86a2342a622b with Priority: HIGHEST for action port [ 968.447827] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-67c3b336-2363-461c-acad-86a2342a622b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.449754] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67c3b336-2363-461c-acad-86a2342a622b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.449754] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67c3b336-2363-461c-acad-86a2342a622b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.449754] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67c3b336-2363-461c-acad-86a2342a622b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.449754] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67c3b336-2363-461c-acad-86a2342a622b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.716857] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb in Status: SUCCESS [ 968.716857] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb deletion is rescheduled due to dependency. [ 968.716857] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.953113] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67c3b336-2363-461c-acad-86a2342a622b [ 968.953113] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.953113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.953113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.953372] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.953442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.953539] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67c3b336-2363-461c-acad-86a2342a622b already deleted. [ 968.953622] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67c3b336-2363-461c-acad-86a2342a622b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.624793] env[69920]: INFO networking_nsxv3.common.synchronization [req-5b4b4f71-6125-47bf-8971-dfa1f9ac5106 req-1a0c45c4-aeac-47f8-bc66-97a6b3e2b7b4 tempest-VolumesAdminNegativeTest-1491739297 tempest-VolumesAdminNegativeTest-1491739297-project-member] Enqueued Resource ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac with Priority: HIGHEST for action security_group_members [ 969.625426] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac with Priority: HIGHEST for action security_group_members [ 969.625584] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.625660] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.625715] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.625892] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.626051] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.626153] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.626318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.626435] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.626786] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.626786] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.130117] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.130325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.130388] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.130809] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.154019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.154296] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.154419] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.154490] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.154705] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.154794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.154883] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac is going to be updated. [ 970.186241] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.186817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.186941] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.187421] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.187580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.197709] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac in Status: IN_PROGRESS for 2s [ 971.383628] env[69920]: INFO networking_nsxv3.common.synchronization [req-8ece0d8d-d9bb-4517-8714-9e1c523c53e9 req-8987a3f0-1301-44e4-ab94-b898b11df23e tempest-ServersV294TestFqdnHostnames-1367069286 tempest-ServersV294TestFqdnHostnames-1367069286-project-member] Enqueued Resource ID: 4d847f61-da82-4a79-82ae-c393059854e9 with Priority: HIGHEST for action security_group_members [ 971.384177] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d847f61-da82-4a79-82ae-c393059854e9 with Priority: HIGHEST for action security_group_members [ 971.384462] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d847f61-da82-4a79-82ae-c393059854e9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.388498] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.388498] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.388498] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.388873] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.388873] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.388873] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.388873] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.388999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.389066] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d847f61-da82-4a79-82ae-c393059854e9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.438956] env[69920]: INFO networking_nsxv3.common.synchronization [None req-08eb9462-c1d5-4676-9747-9d251bbd84f4 None None] Enqueued Resource ID: 12f166db-9fab-4a9b-a443-a6e4e0f175bd with Priority: HIGHEST for action port [ 971.439235] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f166db-9fab-4a9b-a443-a6e4e0f175bd with Priority: HIGHEST for action port [ 971.439793] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-12f166db-9fab-4a9b-a443-a6e4e0f175bd taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.439918] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12f166db-9fab-4a9b-a443-a6e4e0f175bd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.439985] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12f166db-9fab-4a9b-a443-a6e4e0f175bd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.440259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12f166db-9fab-4a9b-a443-a6e4e0f175bd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.440348] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12f166db-9fab-4a9b-a443-a6e4e0f175bd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.892119] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.892357] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.892454] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.892686] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.914499] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.914654] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.914767] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.914828] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.915038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.915116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.918151] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d847f61-da82-4a79-82ae-c393059854e9 is going to be updated. [ 971.938587] env[69920]: INFO networking_nsxv3.common.synchronization [None req-21a18838-d1be-4cf0-831f-5ef5b927eb7c None None] Enqueued Resource ID: 69742a67-4047-4fe6-b035-b8c30712d6a0 with Priority: HIGHEST for action port [ 971.938864] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69742a67-4047-4fe6-b035-b8c30712d6a0 with Priority: HIGHEST for action port [ 971.939493] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-69742a67-4047-4fe6-b035-b8c30712d6a0 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.939663] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69742a67-4047-4fe6-b035-b8c30712d6a0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.939706] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69742a67-4047-4fe6-b035-b8c30712d6a0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.940164] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69742a67-4047-4fe6-b035-b8c30712d6a0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.940258] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69742a67-4047-4fe6-b035-b8c30712d6a0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.944028] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12f166db-9fab-4a9b-a443-a6e4e0f175bd [ 971.944028] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.944028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.944028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.944028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.944028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.944028] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12f166db-9fab-4a9b-a443-a6e4e0f175bd already deleted. [ 971.944028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12f166db-9fab-4a9b-a443-a6e4e0f175bd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.946098] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.946264] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.946366] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.946562] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.947449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.957153] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d847f61-da82-4a79-82ae-c393059854e9 in Status: IN_PROGRESS for 2s [ 972.220753] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac in Status: SUCCESS [ 972.220753] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac deletion is rescheduled due to dependency. [ 972.220753] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.442856] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 69742a67-4047-4fe6-b035-b8c30712d6a0 [ 972.443115] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.445026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.445026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.445026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.445026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.445026] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:69742a67-4047-4fe6-b035-b8c30712d6a0 already deleted. [ 972.445026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69742a67-4047-4fe6-b035-b8c30712d6a0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.542552] env[69920]: INFO networking_nsxv3.common.synchronization [None req-9f1449e4-2901-4425-bc3e-e0dd29fa08a4 tempest-ServersWithSpecificFlavorTestJSON-1780415271 tempest-ServersWithSpecificFlavorTestJSON-1780415271-project-member] Enqueued Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGHEST for action security_group_rules [ 972.543370] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGHEST for action security_group_rules [ 972.543505] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81b4d229-34c1-420c-acac-a5e9d44d33e5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.543630] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.543700] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.543961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.544325] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81b4d229-34c1-420c-acac-a5e9d44d33e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.639914] env[69920]: INFO networking_nsxv3.common.synchronization [None req-c132207c-576a-4bfe-b5db-4aebd81c1279 tempest-ServersWithSpecificFlavorTestJSON-1780415271 tempest-ServersWithSpecificFlavorTestJSON-1780415271-project-member] Enqueued Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGHEST for action security_group_rules [ 972.639914] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGHEST for action security_group_rules [ 972.639914] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81b4d229-34c1-420c-acac-a5e9d44d33e5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.639914] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.065915] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.066116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.066205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.066449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.067398] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.067398] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 already deleted. [ 973.067398] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.067398] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.067398] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.067398] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81b4d229-34c1-420c-acac-a5e9d44d33e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.592014] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.593279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.593279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.593279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.593279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.593279] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 already deleted. [ 973.593279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.968125] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d847f61-da82-4a79-82ae-c393059854e9 in Status: SUCCESS [ 973.968877] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d847f61-da82-4a79-82ae-c393059854e9 deletion is rescheduled due to dependency. [ 973.968877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.264623] env[69920]: INFO networking_nsxv3.common.synchronization [None req-c3e52dd9-ad2a-43ac-acf2-183ff0c630ac None None] Enqueued Resource ID: cee7832f-c6db-4e76-9c73-cf9d1afcf498 with Priority: HIGHEST for action port [ 974.265302] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cee7832f-c6db-4e76-9c73-cf9d1afcf498 with Priority: HIGHEST for action port [ 974.265302] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-cee7832f-c6db-4e76-9c73-cf9d1afcf498 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.268494] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cee7832f-c6db-4e76-9c73-cf9d1afcf498" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.268638] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cee7832f-c6db-4e76-9c73-cf9d1afcf498" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.268944] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cee7832f-c6db-4e76-9c73-cf9d1afcf498" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.269098] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cee7832f-c6db-4e76-9c73-cf9d1afcf498',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.772261] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cee7832f-c6db-4e76-9c73-cf9d1afcf498 [ 974.772514] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.772584] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.772626] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.772818] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.772903] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.772997] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cee7832f-c6db-4e76-9c73-cf9d1afcf498 already deleted. [ 974.773096] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cee7832f-c6db-4e76-9c73-cf9d1afcf498" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.998083] env[69920]: INFO networking_nsxv3.common.synchronization [req-35c55695-37bb-4974-a94a-2553186d8ca6 req-882201c4-f1c7-4296-afa3-8713efb5d299 tempest-ServersAdminTestJSON-859816448 tempest-ServersAdminTestJSON-859816448-project-member] Enqueued Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 976.999496] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 977.000518] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.002183] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.002318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.002590] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.003817] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.004021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.004160] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.004721] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.005158] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.005325] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.475018] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-613 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.475242] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-613" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.475375] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-613" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.475640] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-613" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.475899] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.476444] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.476749] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.477338] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.477338] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.477338] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 977.477338] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 977.477543] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 977.477543] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 977.478053] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 977.478053] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 977.478053] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 977.499299] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 977.499494] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 977.499641] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 977.499880] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-613" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.500170] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-1fbc7a57-ea01-478c-8517-9b5d862bf7cc taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.500356] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-1fbc7a57-ea01-478c-8517-9b5d862bf7cc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.500474] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-1fbc7a57-ea01-478c-8517-9b5d862bf7cc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.500812] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-1fbc7a57-ea01-478c-8517-9b5d862bf7cc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.500959] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fbc7a57-ea01-478c-8517-9b5d862bf7cc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.508567] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.003679] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.004018] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.004115] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.004379] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.004539] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.004702] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 1fbc7a57-ea01-478c-8517-9b5d862bf7cc not found, creating... [ 978.004968] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.005145] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.005270] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.005493] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.005638] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.005921] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.006103] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.006226] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.006472] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.006615] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.006761] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 1fbc7a57-ea01-478c-8517-9b5d862bf7cc is going to be created. [ 978.010364] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.026801] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.027039] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.027187] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.027504] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.027747] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.027989] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-1fbc7a57-ea01-478c-8517-9b5d862bf7cc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.512859] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.513047] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.513121] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.513431] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.513431] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.513601] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a is going to be updated. [ 978.544116] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.544311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.544349] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.544587] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.544808] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.555803] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: IN_PROGRESS for 2s [ 978.865254] env[69920]: INFO networking_nsxv3.common.synchronization [req-35c55695-37bb-4974-a94a-2553186d8ca6 req-1cc981b7-4aa7-4b01-a41f-1a80c94284ea service nova] Enqueued Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_rules [ 978.865254] env[69920]: INFO networking_nsxv3.common.synchronization [req-35c55695-37bb-4974-a94a-2553186d8ca6 req-1cc981b7-4aa7-4b01-a41f-1a80c94284ea service nova] Enqueued Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 978.865254] env[69920]: INFO networking_nsxv3.common.synchronization [req-35c55695-37bb-4974-a94a-2553186d8ca6 req-1cc981b7-4aa7-4b01-a41f-1a80c94284ea service nova] Enqueued Resource ID: 1fbc7a57-ea01-478c-8517-9b5d862bf7cc with Priority: HIGHEST for action port [ 978.865254] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_rules [ 978.865254] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 978.865254] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fbc7a57-ea01-478c-8517-9b5d862bf7cc with Priority: HIGHEST for action port [ 978.865254] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.865254] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.865254] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.865865] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.866176] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.868133] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.870107] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.870107] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fbc7a57-ea01-478c-8517-9b5d862bf7cc taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.870107] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fbc7a57-ea01-478c-8517-9b5d862bf7cc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.870107] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fbc7a57-ea01-478c-8517-9b5d862bf7cc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.870107] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fbc7a57-ea01-478c-8517-9b5d862bf7cc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.870107] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fbc7a57-ea01-478c-8517-9b5d862bf7cc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.368694] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.369083] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.371693] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1fbc7a57-ea01-478c-8517-9b5d862bf7cc with status ACTIVE [ 979.372650] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.372650] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.372650] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.372851] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.372851] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.372944] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.373050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.373174] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.373287] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.373370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.373643] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.373744] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.373807] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.373956] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.374051] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.374140] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1fbc7a57-ea01-478c-8517-9b5d862bf7cc is going to be updated. [ 979.395266] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.395476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.395476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.395679] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.395823] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.395993] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fbc7a57-ea01-478c-8517-9b5d862bf7cc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.638924] env[69920]: INFO networking_nsxv3.common.synchronization [req-f1c128f8-472c-4fad-8e79-26405da21a25 req-d90582f9-4849-4b9e-85a6-0cb61548954e tempest-InstanceActionsTestJSON-1460553136 tempest-InstanceActionsTestJSON-1460553136-project-member] Enqueued Resource ID: 287306e2-c53f-4a5f-82ab-b97a6d8f9e37 with Priority: HIGHEST for action security_group_members [ 979.639486] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287306e2-c53f-4a5f-82ab-b97a6d8f9e37 with Priority: HIGHEST for action security_group_members [ 979.639822] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.640041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.640041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.640278] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.640448] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.640543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.640613] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.640777] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.640861] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.640982] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('287306e2-c53f-4a5f-82ab-b97a6d8f9e37',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.147135] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.147135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.147135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.147135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.147135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.147135] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.147135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.147135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.147135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.147135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.147135] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 287306e2-c53f-4a5f-82ab-b97a6d8f9e37 already deleted. [ 980.147135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.301635] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-365 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.301843] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-365" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.301976] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-365" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.302763] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-365" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.303858] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.304201] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.305072] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.305072] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.305072] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.305232] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 980.305358] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 980.305473] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 980.305583] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 980.305698] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 980.305807] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 980.305946] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 980.329031] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 980.329202] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 980.329347] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 980.329535] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-365" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.329852] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-09ee92f2-f98d-47b8-81a8-b99cdce409e0 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.330040] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-09ee92f2-f98d-47b8-81a8-b99cdce409e0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.330168] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-09ee92f2-f98d-47b8-81a8-b99cdce409e0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.330493] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-09ee92f2-f98d-47b8-81a8-b99cdce409e0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.330641] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09ee92f2-f98d-47b8-81a8-b99cdce409e0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.565984] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: SUCCESS [ 980.566425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.566425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.566642] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.566832] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.566949] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.567032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.567185] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.567271] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.567371] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.832892] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.833155] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.833293] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.833583] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.833751] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.833917] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 09ee92f2-f98d-47b8-81a8-b99cdce409e0 not found, creating... [ 980.834220] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.834431] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.834568] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.834807] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.834955] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.835379] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.835552] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.835683] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.835905] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.836128] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.836305] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 09ee92f2-f98d-47b8-81a8-b99cdce409e0 is going to be created. [ 980.860147] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.860429] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.860565] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.860865] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.862042] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.862042] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-09ee92f2-f98d-47b8-81a8-b99cdce409e0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.070798] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.576755] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.981501] env[69920]: INFO networking_nsxv3.common.synchronization [req-f1c128f8-472c-4fad-8e79-26405da21a25 req-34e373a6-5143-4d23-90ee-688e3b96c238 service nova] Enqueued Resource ID: 287306e2-c53f-4a5f-82ab-b97a6d8f9e37 with Priority: HIGHEST for action security_group_rules [ 981.981762] env[69920]: INFO networking_nsxv3.common.synchronization [req-f1c128f8-472c-4fad-8e79-26405da21a25 req-34e373a6-5143-4d23-90ee-688e3b96c238 service nova] Enqueued Resource ID: 287306e2-c53f-4a5f-82ab-b97a6d8f9e37 with Priority: HIGHEST for action security_group_members [ 981.982012] env[69920]: INFO networking_nsxv3.common.synchronization [req-f1c128f8-472c-4fad-8e79-26405da21a25 req-34e373a6-5143-4d23-90ee-688e3b96c238 service nova] Enqueued Resource ID: 09ee92f2-f98d-47b8-81a8-b99cdce409e0 with Priority: HIGHEST for action port [ 981.982610] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287306e2-c53f-4a5f-82ab-b97a6d8f9e37 with Priority: HIGHEST for action security_group_rules [ 981.982803] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287306e2-c53f-4a5f-82ab-b97a6d8f9e37 with Priority: HIGHEST for action security_group_members [ 981.982945] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09ee92f2-f98d-47b8-81a8-b99cdce409e0 with Priority: HIGHEST for action port [ 981.984173] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-287306e2-c53f-4a5f-82ab-b97a6d8f9e37 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.984308] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.984456] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.985071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.986236] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('287306e2-c53f-4a5f-82ab-b97a6d8f9e37',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.986420] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.986992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.987143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.987386] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.987598] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.987748] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.987945] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.988403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.988468] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.991794] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('287306e2-c53f-4a5f-82ab-b97a6d8f9e37',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.991794] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-09ee92f2-f98d-47b8-81a8-b99cdce409e0 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.991794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09ee92f2-f98d-47b8-81a8-b99cdce409e0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.991794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09ee92f2-f98d-47b8-81a8-b99cdce409e0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.991794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09ee92f2-f98d-47b8-81a8-b99cdce409e0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.991794] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09ee92f2-f98d-47b8-81a8-b99cdce409e0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.081574] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.081857] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.081949] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.082205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.082335] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.082460] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a is going to be updated. [ 982.115684] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.115818] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.115855] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.116095] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.116253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.128154] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: IN_PROGRESS for 2s [ 982.493282] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.493406] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.496720] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09ee92f2-f98d-47b8-81a8-b99cdce409e0 with status ACTIVE [ 982.496937] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.497084] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.497152] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.497377] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.497459] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.497635] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.497735] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.497805] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.497951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.498044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.501086] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.501247] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.501316] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.501491] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.502083] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.502189] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09ee92f2-f98d-47b8-81a8-b99cdce409e0 is going to be updated. [ 982.506678] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('287306e2-c53f-4a5f-82ab-b97a6d8f9e37',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.530343] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.530546] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.530546] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.530767] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.530904] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.531081] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09ee92f2-f98d-47b8-81a8-b99cdce409e0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.733178] env[69920]: INFO networking_nsxv3.common.synchronization [req-b8bd4778-1d14-4663-9565-e9d26ddafbf3 req-c1229279-ea07-4113-bbd3-0fac9a69c850 tempest-AttachInterfacesV270Test-499421490 tempest-AttachInterfacesV270Test-499421490-project-member] Enqueued Resource ID: 0e59b5ff-c965-44e5-b635-07a76f775de9 with Priority: HIGHEST for action security_group_members [ 982.733178] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e59b5ff-c965-44e5-b635-07a76f775de9 with Priority: HIGHEST for action security_group_members [ 982.733178] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e59b5ff-c965-44e5-b635-07a76f775de9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.733178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.733178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.733178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.733178] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.733178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.733178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.733178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.733898] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.734108] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e59b5ff-c965-44e5-b635-07a76f775de9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.010059] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('287306e2-c53f-4a5f-82ab-b97a6d8f9e37',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.236774] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.236946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.237063] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.237261] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.237358] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.237581] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.237699] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.237765] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.237922] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.238009] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.238093] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e59b5ff-c965-44e5-b635-07a76f775de9 already deleted. [ 983.238174] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.515863] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.516147] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.516256] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.516565] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.516723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.516875] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 287306e2-c53f-4a5f-82ab-b97a6d8f9e37 is going to be created. [ 983.542893] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.543194] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.543788] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.543788] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.543788] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.557674] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287306e2-c53f-4a5f-82ab-b97a6d8f9e37 in Status: UNINITIALIZED for 2s [ 983.772069] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-651 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.772401] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-651" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.772460] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-651" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.772736] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-651" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.773009] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.773184] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.773309] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.773533] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.773703] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.773916] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 983.775374] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 983.775374] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 983.775374] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 983.775527] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 983.776397] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 983.776574] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 983.799561] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 983.799561] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 983.799561] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 983.800114] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-651" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.800114] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-866c0d6a-a2a2-45f3-a0e9-06356a7cc46d taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.800324] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-866c0d6a-a2a2-45f3-a0e9-06356a7cc46d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.800403] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-866c0d6a-a2a2-45f3-a0e9-06356a7cc46d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.800907] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-866c0d6a-a2a2-45f3-a0e9-06356a7cc46d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.801146] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('866c0d6a-a2a2-45f3-a0e9-06356a7cc46d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.141565] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: SUCCESS [ 984.141820] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.142212] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.142212] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.142405] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.142522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.142582] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.142823] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.142932] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.143034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.143155] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.304391] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.305578] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.305578] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.305578] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.305578] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.305578] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 866c0d6a-a2a2-45f3-a0e9-06356a7cc46d not found, creating... [ 984.305810] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.305871] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.305977] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.309069] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.309069] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.309069] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.309069] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.309069] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.309069] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.309069] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.309069] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 866c0d6a-a2a2-45f3-a0e9-06356a7cc46d is going to be created. [ 984.329556] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.329773] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.330098] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.330158] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.330408] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.330648] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-866c0d6a-a2a2-45f3-a0e9-06356a7cc46d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.646713] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.646713] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.646713] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.646713] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.646713] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.646713] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.646713] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.647085] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.647085] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.647151] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.647315] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.647597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.647597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.647597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.647751] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.649105] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.649105] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.649105] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.649105] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.649105] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.649105] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.152207] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 154896d4-d0bc-49e9-8d89-5fcc04260b1a: rpc.has_security_group_logging(os_id): False [ 985.170365] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.170365] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.170365] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.170593] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.194462] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.194717] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.194872] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.194906] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.195122] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.195197] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.195415] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.195535] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.195595] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.195751] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.195820] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.196326] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.196326] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.196326] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.196533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.196622] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.196692] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a is going to be updated. [ 985.259859] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.259859] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.260015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.260111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.260285] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.273205] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: IN_PROGRESS for 2s [ 985.350619] env[69920]: INFO networking_nsxv3.common.synchronization [req-08a09734-0a4c-4960-9c4f-48617c847873 req-4d9b2905-587c-4850-831a-266d663d8f16 tempest-ServersAdminNegativeTestJSON-439752242 tempest-ServersAdminNegativeTestJSON-439752242-project-member] Enqueued Resource ID: 33cfaadf-9929-4bc4-a275-43f890595f10 with Priority: HIGHEST for action security_group_members [ 985.351182] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33cfaadf-9929-4bc4-a275-43f890595f10 with Priority: HIGHEST for action security_group_members [ 985.351491] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-33cfaadf-9929-4bc4-a275-43f890595f10 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.351617] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.351684] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.352036] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.353192] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.353355] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.353432] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.353613] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.353712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.353835] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33cfaadf-9929-4bc4-a275-43f890595f10',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.487901] env[69920]: INFO networking_nsxv3.common.synchronization [req-b8bd4778-1d14-4663-9565-e9d26ddafbf3 req-3f45867d-bbb4-45c8-a891-a9d638f179f6 service nova] Enqueued Resource ID: 0e59b5ff-c965-44e5-b635-07a76f775de9 with Priority: HIGHEST for action security_group_rules [ 985.488176] env[69920]: INFO networking_nsxv3.common.synchronization [req-b8bd4778-1d14-4663-9565-e9d26ddafbf3 req-3f45867d-bbb4-45c8-a891-a9d638f179f6 service nova] Enqueued Resource ID: 0e59b5ff-c965-44e5-b635-07a76f775de9 with Priority: HIGHEST for action security_group_members [ 985.488241] env[69920]: INFO networking_nsxv3.common.synchronization [req-b8bd4778-1d14-4663-9565-e9d26ddafbf3 req-3f45867d-bbb4-45c8-a891-a9d638f179f6 service nova] Enqueued Resource ID: 866c0d6a-a2a2-45f3-a0e9-06356a7cc46d with Priority: HIGHEST for action port [ 985.488725] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e59b5ff-c965-44e5-b635-07a76f775de9 with Priority: HIGHEST for action security_group_rules [ 985.488866] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e59b5ff-c965-44e5-b635-07a76f775de9 with Priority: HIGHEST for action security_group_members [ 985.488961] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 866c0d6a-a2a2-45f3-a0e9-06356a7cc46d with Priority: HIGHEST for action port [ 985.489242] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e59b5ff-c965-44e5-b635-07a76f775de9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.489359] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.489426] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.489711] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.489801] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e59b5ff-c965-44e5-b635-07a76f775de9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.492278] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e59b5ff-c965-44e5-b635-07a76f775de9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.492391] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.492461] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.495113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.495306] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.495414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.495480] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.495641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.495778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.495813] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e59b5ff-c965-44e5-b635-07a76f775de9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.496744] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-866c0d6a-a2a2-45f3-a0e9-06356a7cc46d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.496855] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-866c0d6a-a2a2-45f3-a0e9-06356a7cc46d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.496921] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-866c0d6a-a2a2-45f3-a0e9-06356a7cc46d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.497091] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-866c0d6a-a2a2-45f3-a0e9-06356a7cc46d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.497169] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('866c0d6a-a2a2-45f3-a0e9-06356a7cc46d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.567883] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287306e2-c53f-4a5f-82ab-b97a6d8f9e37 in Status: SUCCESS [ 985.568116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.568283] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.568497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.568761] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.568888] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.568952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.569154] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.569240] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.569327] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.570112] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('287306e2-c53f-4a5f-82ab-b97a6d8f9e37',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.856618] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33cfaadf-9929-4bc4-a275-43f890595f10',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.976898] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-207 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.976898] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.977165] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.977219] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.977568] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.977740] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.977869] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.978101] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.978248] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.978457] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 985.979115] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 985.979115] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 985.979115] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 985.979115] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 985.979115] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 985.979401] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 985.999071] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e59b5ff-c965-44e5-b635-07a76f775de9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.002520] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e59b5ff-c965-44e5-b635-07a76f775de9 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.002520] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.002520] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.002520] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 986.002520] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.002520] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-207" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.002520] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-a4ba62a2-72b5-465c-bd2e-9ff3bff9da1c taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.002520] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-a4ba62a2-72b5-465c-bd2e-9ff3bff9da1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.003053] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-a4ba62a2-72b5-465c-bd2e-9ff3bff9da1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.003724] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-a4ba62a2-72b5-465c-bd2e-9ff3bff9da1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.003871] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4ba62a2-72b5-465c-bd2e-9ff3bff9da1c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.004651] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 866c0d6a-a2a2-45f3-a0e9-06356a7cc46d with status ACTIVE [ 986.004831] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.004945] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.005018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.005248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.005344] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.005536] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.005639] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.007472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.007472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.007472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.007472] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.007472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.007472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.007472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.007472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.007472] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 866c0d6a-a2a2-45f3-a0e9-06356a7cc46d is going to be updated. [ 986.029485] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.029485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.029485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.029485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.029485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.029485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-866c0d6a-a2a2-45f3-a0e9-06356a7cc46d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.073215] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.073215] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.073215] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.073215] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.074385] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.074385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.074385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.074385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.074385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.074385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.074385] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.074385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.074385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.074385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.074832] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.074832] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.074832] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.074832] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.074832] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.074974] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.074974] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('287306e2-c53f-4a5f-82ab-b97a6d8f9e37',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.358660] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33cfaadf-9929-4bc4-a275-43f890595f10',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.501590] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e59b5ff-c965-44e5-b635-07a76f775de9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.512068] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.512068] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.512068] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.512068] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.512068] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.512068] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port a4ba62a2-72b5-465c-bd2e-9ff3bff9da1c not found, creating... [ 986.512068] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.512068] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.512068] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.512068] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.512068] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.513141] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.516021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.516021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.516021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.516021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.516021] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: a4ba62a2-72b5-465c-bd2e-9ff3bff9da1c is going to be created. [ 986.541009] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.542903] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.543282] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.545020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.545020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.545020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-a4ba62a2-72b5-465c-bd2e-9ff3bff9da1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.581590] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 287306e2-c53f-4a5f-82ab-b97a6d8f9e37: rpc.has_security_group_logging(os_id): False [ 986.609196] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.609931] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.610224] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.610594] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.611202] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.611622] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.611941] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.612172] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.612680] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.613424] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.613424] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.614129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.614129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.614129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.618048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.618048] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.618048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.618048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.618048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.618048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.618048] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 287306e2-c53f-4a5f-82ab-b97a6d8f9e37 is going to be created. [ 986.749072] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.749521] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.749521] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.749753] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.749898] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.762863] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 287306e2-c53f-4a5f-82ab-b97a6d8f9e37 in Status: IN_PROGRESS for 2s [ 986.862611] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.862611] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.862611] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.862611] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.862611] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.862864] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33cfaadf-9929-4bc4-a275-43f890595f10 is going to be updated. [ 986.899778] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.899778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.899778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.899778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.899778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.908577] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33cfaadf-9929-4bc4-a275-43f890595f10 in Status: IN_PROGRESS for 2s [ 987.004976] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.004976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.004976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.004976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.004976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.004976] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e59b5ff-c965-44e5-b635-07a76f775de9 is going to be created. [ 987.040130] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.040130] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.040130] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.040130] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.040130] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.053053] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e59b5ff-c965-44e5-b635-07a76f775de9 in Status: UNINITIALIZED for 2s [ 987.289252] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: SUCCESS [ 987.289893] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.480264] env[69920]: INFO networking_nsxv3.common.synchronization [None req-ed5f4fda-0c3d-4f9a-9496-c172fd89f96e None None] Enqueued Resource ID: 6139c1e7-2f4f-4508-9c3f-df7e94734996 with Priority: HIGHEST for action port [ 987.480559] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6139c1e7-2f4f-4508-9c3f-df7e94734996 with Priority: HIGHEST for action port [ 987.481113] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-6139c1e7-2f4f-4508-9c3f-df7e94734996 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.481237] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6139c1e7-2f4f-4508-9c3f-df7e94734996" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.481303] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6139c1e7-2f4f-4508-9c3f-df7e94734996" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.481561] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6139c1e7-2f4f-4508-9c3f-df7e94734996" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.481649] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6139c1e7-2f4f-4508-9c3f-df7e94734996',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.984818] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6139c1e7-2f4f-4508-9c3f-df7e94734996 [ 987.985057] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.985198] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.985266] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.985472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.985564] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.985657] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6139c1e7-2f4f-4508-9c3f-df7e94734996 already deleted. [ 987.985737] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6139c1e7-2f4f-4508-9c3f-df7e94734996" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.054432] env[69920]: INFO networking_nsxv3.common.synchronization [req-08a09734-0a4c-4960-9c4f-48617c847873 req-ec281b98-daae-4ea8-a69e-24ef7a1b6c89 service nova] Enqueued Resource ID: 33cfaadf-9929-4bc4-a275-43f890595f10 with Priority: HIGHEST for action security_group_rules [ 988.054608] env[69920]: INFO networking_nsxv3.common.synchronization [req-08a09734-0a4c-4960-9c4f-48617c847873 req-ec281b98-daae-4ea8-a69e-24ef7a1b6c89 service nova] Enqueued Resource ID: 33cfaadf-9929-4bc4-a275-43f890595f10 with Priority: HIGHEST for action security_group_members [ 988.054742] env[69920]: INFO networking_nsxv3.common.synchronization [req-08a09734-0a4c-4960-9c4f-48617c847873 req-ec281b98-daae-4ea8-a69e-24ef7a1b6c89 service nova] Enqueued Resource ID: a4ba62a2-72b5-465c-bd2e-9ff3bff9da1c with Priority: HIGHEST for action port [ 988.054961] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33cfaadf-9929-4bc4-a275-43f890595f10 with Priority: HIGHEST for action security_group_rules [ 988.055095] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33cfaadf-9929-4bc4-a275-43f890595f10 with Priority: HIGHEST for action security_group_members [ 988.055199] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4ba62a2-72b5-465c-bd2e-9ff3bff9da1c with Priority: HIGHEST for action port [ 988.055740] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33cfaadf-9929-4bc4-a275-43f890595f10 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.055860] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.055927] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.059906] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.060021] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33cfaadf-9929-4bc4-a275-43f890595f10',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.060927] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-33cfaadf-9929-4bc4-a275-43f890595f10 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.061038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.061247] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4ba62a2-72b5-465c-bd2e-9ff3bff9da1c taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.061349] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4ba62a2-72b5-465c-bd2e-9ff3bff9da1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.061416] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4ba62a2-72b5-465c-bd2e-9ff3bff9da1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.061944] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4ba62a2-72b5-465c-bd2e-9ff3bff9da1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.062057] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4ba62a2-72b5-465c-bd2e-9ff3bff9da1c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.565948] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-33cfaadf-9929-4bc4-a275-43f890595f10 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.566319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.566319] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4ba62a2-72b5-465c-bd2e-9ff3bff9da1c with status ACTIVE [ 988.566517] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.566652] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.566721] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.566935] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.567046] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.567215] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.567314] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.567395] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.567566] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.567661] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.567854] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.567952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.568025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.568173] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.568249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.568333] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4ba62a2-72b5-465c-bd2e-9ff3bff9da1c is going to be updated. [ 988.595526] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.598988] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.598988] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.598988] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.598988] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.598988] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4ba62a2-72b5-465c-bd2e-9ff3bff9da1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.775623] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 287306e2-c53f-4a5f-82ab-b97a6d8f9e37 in Status: SUCCESS [ 988.775623] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.921425] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33cfaadf-9929-4bc4-a275-43f890595f10 in Status: SUCCESS [ 988.921796] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.922129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.922443] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.922721] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.922973] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.923144] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.923383] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.923599] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.923783] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33cfaadf-9929-4bc4-a275-43f890595f10',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.061615] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e59b5ff-c965-44e5-b635-07a76f775de9 in Status: SUCCESS [ 989.061877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.062052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.062277] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.062470] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.062584] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.062650] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.062802] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.062883] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.062968] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.063073] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e59b5ff-c965-44e5-b635-07a76f775de9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.427960] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33cfaadf-9929-4bc4-a275-43f890595f10',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.565988] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e59b5ff-c965-44e5-b635-07a76f775de9 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.569677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.569677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.569677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.569677] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.569677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.569677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.569677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.569677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.569677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.569677] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e59b5ff-c965-44e5-b635-07a76f775de9 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.569677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.569677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.569677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.569677] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.570245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.570245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.570245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.570245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.570245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.570245] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e59b5ff-c965-44e5-b635-07a76f775de9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.740541] env[69920]: INFO networking_nsxv3.common.synchronization [None req-2d9077c9-f34b-4ed5-8ed7-69ebcf3f1d07 None None] Enqueued Resource ID: 001d6d24-9298-471c-b91b-da035e094a51 with Priority: HIGHEST for action port [ 989.740710] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 001d6d24-9298-471c-b91b-da035e094a51 with Priority: HIGHEST for action port [ 989.741924] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-001d6d24-9298-471c-b91b-da035e094a51 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.741924] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-001d6d24-9298-471c-b91b-da035e094a51" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.741924] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-001d6d24-9298-471c-b91b-da035e094a51" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.741924] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-001d6d24-9298-471c-b91b-da035e094a51" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.741924] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('001d6d24-9298-471c-b91b-da035e094a51',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.932829] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33cfaadf-9929-4bc4-a275-43f890595f10',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.077315] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e59b5ff-c965-44e5-b635-07a76f775de9: rpc.has_security_group_logging(os_id): False [ 990.105268] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.105268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.105268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.105268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.105268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.105268] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.105268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.105268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.105268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.105803] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.106143] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.106383] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.106553] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.106815] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.106989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.107318] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.107701] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.107884] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.108269] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.108493] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.109252] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e59b5ff-c965-44e5-b635-07a76f775de9 is going to be created. [ 990.181620] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.181829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.181829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.182089] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.182272] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.197232] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e59b5ff-c965-44e5-b635-07a76f775de9 in Status: IN_PROGRESS for 2s [ 990.246620] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 001d6d24-9298-471c-b91b-da035e094a51 [ 990.246620] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.246620] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.246620] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.246620] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.246620] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.246620] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:001d6d24-9298-471c-b91b-da035e094a51 already deleted. [ 990.246620] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-001d6d24-9298-471c-b91b-da035e094a51" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.436029] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.436210] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.436316] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.436763] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.436845] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.437013] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33cfaadf-9929-4bc4-a275-43f890595f10 is going to be updated. [ 990.474968] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.475100] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.475184] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.475353] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.475499] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.485801] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33cfaadf-9929-4bc4-a275-43f890595f10 in Status: IN_PROGRESS for 2s [ 991.958304] env[69920]: INFO networking_nsxv3.common.synchronization [req-1b9e9972-4117-43a3-91cb-d605bfe1fb86 req-9d6c4190-043f-4f24-a70e-6873341d7682 tempest-ServersTestFqdnHostnames-61407453 tempest-ServersTestFqdnHostnames-61407453-project-member] Enqueued Resource ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 with Priority: HIGHEST for action security_group_members [ 991.958948] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 with Priority: HIGHEST for action security_group_members [ 991.959295] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2ff1e5d-d0c8-419d-bc14-18543641dd30 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.959414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.959492] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.959744] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.959906] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.964128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.964368] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.964639] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.964751] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.964872] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2ff1e5d-d0c8-419d-bc14-18543641dd30',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.213655] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e59b5ff-c965-44e5-b635-07a76f775de9 in Status: SUCCESS [ 992.213655] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.471120] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.471120] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.471120] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.471120] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.471120] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.471120] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.471120] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.471120] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.471120] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.471120] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.471120] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 already deleted. [ 992.471120] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.505205] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33cfaadf-9929-4bc4-a275-43f890595f10 in Status: SUCCESS [ 992.505205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.505205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.505205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.505205] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.505205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.505205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.505205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.505205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.505205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.505205] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33cfaadf-9929-4bc4-a275-43f890595f10',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.814739] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-179 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.815049] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-179" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.817492] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-179" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.817492] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-179" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.817492] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.817492] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.817492] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.817492] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.817492] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.817492] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 992.817853] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 992.817853] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 992.818026] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 992.818523] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 992.818523] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 992.818643] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 992.841877] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 992.842131] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 992.842249] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 992.842422] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-179" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.842851] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-3edeb122-1a25-4dcd-93fc-1dcf798a6da1 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.843078] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-3edeb122-1a25-4dcd-93fc-1dcf798a6da1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.843252] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-3edeb122-1a25-4dcd-93fc-1dcf798a6da1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.843675] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-3edeb122-1a25-4dcd-93fc-1dcf798a6da1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.843840] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3edeb122-1a25-4dcd-93fc-1dcf798a6da1',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.008148] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-33cfaadf-9929-4bc4-a275-43f890595f10 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.008530] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.008530] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.008853] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.009150] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.009326] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.009449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.009751] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.009868] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.009966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.010137] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-33cfaadf-9929-4bc4-a275-43f890595f10 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.010250] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.010337] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.010475] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.010614] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.010714] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.010773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.011236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.011394] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.011500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.011597] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33cfaadf-9929-4bc4-a275-43f890595f10',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.350140] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.350140] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.350140] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.350140] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.350140] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.350140] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 3edeb122-1a25-4dcd-93fc-1dcf798a6da1 not found, creating... [ 993.350140] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.350140] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.350140] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.350140] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.351036] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.352281] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.352281] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.352281] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.353033] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.353033] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.353033] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 3edeb122-1a25-4dcd-93fc-1dcf798a6da1 is going to be created. [ 993.380039] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.380039] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.380039] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.380039] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.380039] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.380039] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-3edeb122-1a25-4dcd-93fc-1dcf798a6da1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.514536] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33cfaadf-9929-4bc4-a275-43f890595f10: rpc.has_security_group_logging(os_id): False [ 993.533499] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.533645] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.533697] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.533908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.560309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.560648] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.560768] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.560768] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.560969] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.561118] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.561335] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.561436] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.561495] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.561665] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.561744] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.561942] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.562059] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.562095] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.562245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.562321] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.562403] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33cfaadf-9929-4bc4-a275-43f890595f10 is going to be updated. [ 993.631859] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.631859] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.631859] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.632130] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.632624] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.646938] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33cfaadf-9929-4bc4-a275-43f890595f10 in Status: IN_PROGRESS for 2s [ 994.461864] env[69920]: INFO networking_nsxv3.common.synchronization [req-6781f3a0-efb9-4a4e-a5f7-458bf92ae990 req-d92873be-aabf-4723-bf9e-411f166da651 tempest-DeleteServersTestJSON-1690074738 tempest-DeleteServersTestJSON-1690074738-project-member] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 994.461864] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 994.461864] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.461864] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.461864] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.462311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.462311] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.462311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.462430] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.462497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.462583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.462675] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.513048] env[69920]: INFO networking_nsxv3.common.synchronization [req-1b9e9972-4117-43a3-91cb-d605bfe1fb86 req-ae39bdd9-b17c-48f3-b272-8eb01601d3ff service nova] Enqueued Resource ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 with Priority: HIGHEST for action security_group_rules [ 994.513281] env[69920]: INFO networking_nsxv3.common.synchronization [req-1b9e9972-4117-43a3-91cb-d605bfe1fb86 req-ae39bdd9-b17c-48f3-b272-8eb01601d3ff service nova] Enqueued Resource ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 with Priority: HIGHEST for action security_group_members [ 994.513504] env[69920]: INFO networking_nsxv3.common.synchronization [req-1b9e9972-4117-43a3-91cb-d605bfe1fb86 req-ae39bdd9-b17c-48f3-b272-8eb01601d3ff service nova] Enqueued Resource ID: 3edeb122-1a25-4dcd-93fc-1dcf798a6da1 with Priority: HIGHEST for action port [ 994.513895] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 with Priority: HIGHEST for action security_group_rules [ 994.513992] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 with Priority: HIGHEST for action security_group_members [ 994.514162] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3edeb122-1a25-4dcd-93fc-1dcf798a6da1 with Priority: HIGHEST for action port [ 994.514811] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2ff1e5d-d0c8-419d-bc14-18543641dd30 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.515361] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.515361] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.515361] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.516363] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2ff1e5d-d0c8-419d-bc14-18543641dd30',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.519947] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2ff1e5d-d0c8-419d-bc14-18543641dd30 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.520090] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.520157] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.520343] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.520490] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.520581] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.520640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.520779] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.520859] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.520948] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2ff1e5d-d0c8-419d-bc14-18543641dd30',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.523028] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-3edeb122-1a25-4dcd-93fc-1dcf798a6da1 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.523028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3edeb122-1a25-4dcd-93fc-1dcf798a6da1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.523028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3edeb122-1a25-4dcd-93fc-1dcf798a6da1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.523028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3edeb122-1a25-4dcd-93fc-1dcf798a6da1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.523028] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3edeb122-1a25-4dcd-93fc-1dcf798a6da1',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.774669] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-105 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.774959] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.775245] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.775670] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.776055] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.776296] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.776498] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.776743] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.776895] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.777135] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.777235] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.777344] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.777481] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.777611] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.777721] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.777855] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.799023] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.799023] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 994.799023] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.799193] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.799503] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-89f92ae9-a8f4-402a-b248-cc3ad9bf67d7 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.799675] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-89f92ae9-a8f4-402a-b248-cc3ad9bf67d7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.799832] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-89f92ae9-a8f4-402a-b248-cc3ad9bf67d7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.800147] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-89f92ae9-a8f4-402a-b248-cc3ad9bf67d7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.800295] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89f92ae9-a8f4-402a-b248-cc3ad9bf67d7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.965902] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.966092] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.966193] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.966398] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.991349] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.991622] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.991764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.991832] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.992045] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.992127] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.992219] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be updated. [ 995.031501] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2ff1e5d-d0c8-419d-bc14-18543641dd30 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.031501] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.031501] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2ff1e5d-d0c8-419d-bc14-18543641dd30',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.031501] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3edeb122-1a25-4dcd-93fc-1dcf798a6da1 with status ACTIVE [ 995.031501] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.031501] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.031501] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.031501] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.031501] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.031501] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.031501] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.031501] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.031501] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.031501] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.032390] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.032390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.032390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.032390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.032390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.032390] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3edeb122-1a25-4dcd-93fc-1dcf798a6da1 is going to be updated. [ 995.034322] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.034322] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.034322] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.034322] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.034322] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.049966] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: IN_PROGRESS for 2s [ 995.065948] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.066157] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.066249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.066629] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.066870] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.067111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3edeb122-1a25-4dcd-93fc-1dcf798a6da1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.306189] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.306189] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.306189] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.306189] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.306189] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.306189] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 89f92ae9-a8f4-402a-b248-cc3ad9bf67d7 not found, creating... [ 995.306189] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.306189] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.306189] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.306189] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.306189] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.306898] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.306898] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.306898] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.307041] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.307232] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.307421] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 89f92ae9-a8f4-402a-b248-cc3ad9bf67d7 is going to be created. [ 995.333336] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.333642] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.333793] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.334104] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.335349] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.335349] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-89f92ae9-a8f4-402a-b248-cc3ad9bf67d7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.538781] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2ff1e5d-d0c8-419d-bc14-18543641dd30',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.662876] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33cfaadf-9929-4bc4-a275-43f890595f10 in Status: SUCCESS [ 995.663165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.045157] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.045387] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.045387] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.045604] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.045695] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.045798] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 is going to be created. [ 996.071033] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.071033] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.071033] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.071033] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.071033] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.083044] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 in Status: UNINITIALIZED for 2s [ 996.124801] env[69920]: INFO networking_nsxv3.common.synchronization [req-6781f3a0-efb9-4a4e-a5f7-458bf92ae990 req-d49c36e6-4858-4d06-a885-e0af514c1960 service nova] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_rules [ 996.125081] env[69920]: INFO networking_nsxv3.common.synchronization [req-6781f3a0-efb9-4a4e-a5f7-458bf92ae990 req-d49c36e6-4858-4d06-a885-e0af514c1960 service nova] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 996.125334] env[69920]: INFO networking_nsxv3.common.synchronization [req-6781f3a0-efb9-4a4e-a5f7-458bf92ae990 req-d49c36e6-4858-4d06-a885-e0af514c1960 service nova] Enqueued Resource ID: 89f92ae9-a8f4-402a-b248-cc3ad9bf67d7 with Priority: HIGHEST for action port [ 996.125870] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_rules [ 996.126543] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 996.126779] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89f92ae9-a8f4-402a-b248-cc3ad9bf67d7 with Priority: HIGHEST for action port [ 996.127417] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.127417] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.127417] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.127779] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.127779] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.136022] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.136022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.136022] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-89f92ae9-a8f4-402a-b248-cc3ad9bf67d7 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.136022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89f92ae9-a8f4-402a-b248-cc3ad9bf67d7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.136022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89f92ae9-a8f4-402a-b248-cc3ad9bf67d7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.136022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89f92ae9-a8f4-402a-b248-cc3ad9bf67d7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.136022] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89f92ae9-a8f4-402a-b248-cc3ad9bf67d7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.438023] env[69920]: INFO networking_nsxv3.common.synchronization [req-69b1c369-ac99-45da-b319-7fb2ccdd8df1 req-2e101fa8-19ae-4516-80ec-21862aac5fc5 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 996.438023] env[69920]: INFO networking_nsxv3.common.synchronization [req-69b1c369-ac99-45da-b319-7fb2ccdd8df1 req-2e101fa8-19ae-4516-80ec-21862aac5fc5 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 with Priority: HIGHEST for action security_group_members [ 996.438023] env[69920]: INFO networking_nsxv3.common.synchronization [req-69b1c369-ac99-45da-b319-7fb2ccdd8df1 req-2e101fa8-19ae-4516-80ec-21862aac5fc5 tempest-SecurityGroupsTestJSON-258323803 tempest-SecurityGroupsTestJSON-258323803-project-member] Enqueued Resource ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 with Priority: HIGHEST for action security_group_members [ 996.438430] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGHEST for action security_group_members [ 996.438775] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 with Priority: HIGHEST for action security_group_members [ 996.439035] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 with Priority: HIGHEST for action security_group_members [ 996.441812] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.441812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.441812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.441812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.441812] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.441812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.441812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.441812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.441812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.441812] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.443975] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9141c37-2b91-4c20-add2-e8a0090bfc23 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.443975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.443975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.443975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.443975] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.443975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.443975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.443975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.443975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.443975] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9141c37-2b91-4c20-add2-e8a0090bfc23',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.445108] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cbc5f86-4dd3-4809-8201-0103be329ab2 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.445408] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.445408] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.445508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.445586] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.445679] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.445737] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.447428] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.447428] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.447428] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cbc5f86-4dd3-4809-8201-0103be329ab2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.633301] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.633604] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.635874] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89f92ae9-a8f4-402a-b248-cc3ad9bf67d7 with status ACTIVE [ 996.636161] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.636319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.636412] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.636696] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.636869] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.637137] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.637222] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.637309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.637468] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.637551] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.637774] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.637874] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.637948] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.638108] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.638186] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.638275] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89f92ae9-a8f4-402a-b248-cc3ad9bf67d7 is going to be updated. [ 996.668575] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.668873] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.668951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.669190] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.669333] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.669505] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89f92ae9-a8f4-402a-b248-cc3ad9bf67d7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.949020] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.949279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.949428] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.949701] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.953379] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.953530] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.953899] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.957101] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.974869] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.974869] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.974869] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.975161] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.975161] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.975231] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.975326] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 is going to be updated. [ 996.976431] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.977712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.977712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.977712] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.977712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.977712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.977712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.977712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.977712] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 is going to be updated. [ 996.978744] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.978881] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.012799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.013128] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.013275] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.013362] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.013599] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.013757] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.013908] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 is going to be updated. [ 997.018559] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.018823] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.018823] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.018980] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.019111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.020812] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.020986] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.020986] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.022395] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.022660] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.033158] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: IN_PROGRESS for 2s [ 997.033858] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 in Status: IN_PROGRESS for 2s [ 997.053640] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.054052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.054237] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.054493] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.054662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.064851] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 in Status: IN_PROGRESS for 2s [ 997.065964] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: SUCCESS [ 997.066215] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a deletion is rescheduled due to dependency. [ 997.066748] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.066748] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.066748] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.066959] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.067328] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.067328] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.067328] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.067850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.067850] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.405061] env[69920]: INFO networking_nsxv3.common.synchronization [req-1d9731cb-cd08-4942-9a07-d56808f8d2e2 req-5936371a-320d-44c0-b239-93ab9db74bbe tempest-AttachVolumeNegativeTest-700673554 tempest-AttachVolumeNegativeTest-700673554-project-member] Enqueued Resource ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 with Priority: HIGHEST for action security_group_members [ 997.406427] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 with Priority: HIGHEST for action security_group_members [ 997.406427] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1780a9d7-a751-45c5-b020-85c8fdadacd9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.406637] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.406637] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.407169] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.407296] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.407555] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.407620] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.408367] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.408367] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.408367] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1780a9d7-a751-45c5-b020-85c8fdadacd9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.574020] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.822507] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.822930] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-861" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.822930] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-861" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.823224] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-861" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.823519] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.823721] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.823878] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.824149] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.824360] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.824684] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 997.824860] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 997.825029] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 997.825180] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 997.825402] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 997.825544] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 997.825712] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 997.844938] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 997.845130] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 997.845274] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 997.845457] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-861" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.845786] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-f0303e15-89fc-4eb7-825c-9b0cea4b5718 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.845962] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-f0303e15-89fc-4eb7-825c-9b0cea4b5718" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.846096] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-f0303e15-89fc-4eb7-825c-9b0cea4b5718" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.846424] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-f0303e15-89fc-4eb7-825c-9b0cea4b5718" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.846635] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0303e15-89fc-4eb7-825c-9b0cea4b5718',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.916342] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.916342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.916342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.916342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.916342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.916342] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.916342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.916342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.916342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.916342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.916342] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 already deleted. [ 997.916342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.076017] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.093056] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 in Status: SUCCESS [ 998.093285] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.093451] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.093702] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.093895] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.094049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.094119] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.094278] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.094380] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.094487] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.094584] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2ff1e5d-d0c8-419d-bc14-18543641dd30',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.349433] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.350219] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.350219] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.350574] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.350574] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.350777] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port f0303e15-89fc-4eb7-825c-9b0cea4b5718 not found, creating... [ 998.351144] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.351415] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.351593] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.351970] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.352516] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.353900] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.354182] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.354398] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.354866] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.355224] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.355561] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: f0303e15-89fc-4eb7-825c-9b0cea4b5718 is going to be created. [ 998.388575] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.392030] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.392030] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.392030] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.392030] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.392030] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-f0303e15-89fc-4eb7-825c-9b0cea4b5718" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.578401] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.578599] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.578641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.578955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.579058] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.579159] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be updated. [ 998.596594] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2ff1e5d-d0c8-419d-bc14-18543641dd30',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.628098] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.628098] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.628098] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.628098] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.628098] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.637322] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: IN_PROGRESS for 2s [ 999.046365] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 in Status: SUCCESS [ 999.046751] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 deletion is rescheduled due to dependency. [ 999.046751] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.047586] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 in Status: SUCCESS [ 999.047738] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 deletion is rescheduled due to dependency. [ 999.047825] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.081991] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 in Status: SUCCESS [ 999.082962] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 deletion is rescheduled due to dependency. [ 999.082962] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.101011] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2ff1e5d-d0c8-419d-bc14-18543641dd30: rpc.has_security_group_logging(os_id): False [ 999.121817] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.121977] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.122061] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.122279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.122373] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.122872] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.122872] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.122872] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.123086] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.123086] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.123177] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 is going to be created. [ 999.212584] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.212727] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.212808] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.213033] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.213222] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.229694] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 in Status: IN_PROGRESS for 2s [ 999.476431] env[69920]: INFO networking_nsxv3.common.synchronization [req-1d9731cb-cd08-4942-9a07-d56808f8d2e2 req-9e12c81b-9cdf-48c7-88d8-e904c9e1d2f3 service nova] Enqueued Resource ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 with Priority: HIGHEST for action security_group_rules [ 999.476688] env[69920]: INFO networking_nsxv3.common.synchronization [req-1d9731cb-cd08-4942-9a07-d56808f8d2e2 req-9e12c81b-9cdf-48c7-88d8-e904c9e1d2f3 service nova] Enqueued Resource ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 with Priority: HIGHEST for action security_group_members [ 999.476834] env[69920]: INFO networking_nsxv3.common.synchronization [req-1d9731cb-cd08-4942-9a07-d56808f8d2e2 req-9e12c81b-9cdf-48c7-88d8-e904c9e1d2f3 service nova] Enqueued Resource ID: f0303e15-89fc-4eb7-825c-9b0cea4b5718 with Priority: HIGHEST for action port [ 999.477093] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 with Priority: HIGHEST for action security_group_rules [ 999.477213] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 with Priority: HIGHEST for action security_group_members [ 999.477302] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0303e15-89fc-4eb7-825c-9b0cea4b5718 with Priority: HIGHEST for action port [ 999.477940] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1780a9d7-a751-45c5-b020-85c8fdadacd9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.478071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.478136] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.478338] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.478418] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1780a9d7-a751-45c5-b020-85c8fdadacd9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.484111] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1780a9d7-a751-45c5-b020-85c8fdadacd9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.484111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.484111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.484111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.484111] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.484111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.484111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.484111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.484111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.484111] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1780a9d7-a751-45c5-b020-85c8fdadacd9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.485144] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0303e15-89fc-4eb7-825c-9b0cea4b5718 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.485293] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0303e15-89fc-4eb7-825c-9b0cea4b5718" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.485368] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0303e15-89fc-4eb7-825c-9b0cea4b5718" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.485532] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0303e15-89fc-4eb7-825c-9b0cea4b5718" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.485663] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0303e15-89fc-4eb7-825c-9b0cea4b5718',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.853903] env[69920]: INFO networking_nsxv3.common.synchronization [None req-6cf41dbd-98fd-4702-a8ed-6e180cb5e813 None None] Enqueued Resource ID: cfaa82e2-ffca-409c-b3dc-396d82c54b26 with Priority: HIGHEST for action port [ 999.854394] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfaa82e2-ffca-409c-b3dc-396d82c54b26 with Priority: HIGHEST for action port [ 999.855214] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfaa82e2-ffca-409c-b3dc-396d82c54b26 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.855378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfaa82e2-ffca-409c-b3dc-396d82c54b26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.855455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfaa82e2-ffca-409c-b3dc-396d82c54b26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.855821] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfaa82e2-ffca-409c-b3dc-396d82c54b26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.855939] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfaa82e2-ffca-409c-b3dc-396d82c54b26',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.983553] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1780a9d7-a751-45c5-b020-85c8fdadacd9 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.983553] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.986108] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1780a9d7-a751-45c5-b020-85c8fdadacd9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.987531] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f0303e15-89fc-4eb7-825c-9b0cea4b5718 with status ACTIVE [ 999.987736] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.987858] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.987924] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.988206] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.988271] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.988590] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.988590] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.988590] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.988740] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.989462] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.989462] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.989462] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.989462] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.989462] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.989462] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.989861] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f0303e15-89fc-4eb7-825c-9b0cea4b5718 is going to be updated. [ 1000.013130] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.013284] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.013359] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.013723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.013986] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.014070] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0303e15-89fc-4eb7-825c-9b0cea4b5718" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.147918] env[69920]: INFO networking_nsxv3.common.synchronization [req-1449223b-d767-473c-afe2-b9d5a7bc7cf5 req-5a52df8d-e0a5-4484-8368-0a5b0166a760 tempest-ServerActionsTestOtherB-54229569 tempest-ServerActionsTestOtherB-54229569-project-member] Enqueued Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_members [ 1000.147918] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_members [ 1000.148324] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.150140] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.150233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.150540] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.150736] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.150892] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.154025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.154025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.154025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.154025] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.361633] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cfaa82e2-ffca-409c-b3dc-396d82c54b26 [ 1000.361633] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.361633] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.361633] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.361905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.361905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.361998] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cfaa82e2-ffca-409c-b3dc-396d82c54b26 already deleted. [ 1000.361998] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfaa82e2-ffca-409c-b3dc-396d82c54b26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.488475] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1780a9d7-a751-45c5-b020-85c8fdadacd9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.647758] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: SUCCESS [ 1000.647837] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.648038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.648269] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.648468] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.648605] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.648662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.648830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.648974] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.648974] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.649111] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.656850] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.656962] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.657038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.657223] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.657311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.657514] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.657664] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.657747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.657906] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.657984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.658081] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b already deleted. [ 1000.658164] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.847172] env[69920]: INFO networking_nsxv3.common.synchronization [None req-57a71d5a-c373-4f49-a665-849fa7e2ced7 tempest-AttachInterfacesTestJSON-901858583 tempest-AttachInterfacesTestJSON-901858583-project-member] Enqueued Resource ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 with Priority: HIGHEST for action security_group_rules [ 1000.847696] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 with Priority: HIGHEST for action security_group_rules [ 1000.850728] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e086b64-be51-49af-ac2c-6312cfa54bf4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.850728] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.850728] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.850728] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.850728] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e086b64-be51-49af-ac2c-6312cfa54bf4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.935356] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.935356] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-690" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.935356] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-690" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.936460] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-690" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.937288] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.937777] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.938175] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.938715] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.941101] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.941101] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1000.941101] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1000.941101] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1000.941101] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1000.941101] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1000.941101] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1000.941101] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1000.968446] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1000.968446] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1000.968446] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1000.968446] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-690" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.968446] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-af2d617c-7a43-466f-b19d-3cce0c52c836 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.968446] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-af2d617c-7a43-466f-b19d-3cce0c52c836" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.968446] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-af2d617c-7a43-466f-b19d-3cce0c52c836" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.968446] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-af2d617c-7a43-466f-b19d-3cce0c52c836" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.968446] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af2d617c-7a43-466f-b19d-3cce0c52c836',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.993430] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.993669] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.993669] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.993867] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.994027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.994101] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 is going to be created. [ 1001.020783] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.020971] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.020971] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.021310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.021577] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.034189] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 in Status: UNINITIALIZED for 2s [ 1001.041142] env[69920]: INFO networking_nsxv3.common.synchronization [None req-7989e7e8-fca5-4caa-a0d7-b062e31e38b2 tempest-AttachInterfacesTestJSON-901858583 tempest-AttachInterfacesTestJSON-901858583-project-member] Enqueued Resource ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 with Priority: HIGHEST for action security_group_rules [ 1001.041786] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 with Priority: HIGHEST for action security_group_rules [ 1001.042083] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e086b64-be51-49af-ac2c-6312cfa54bf4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.042189] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.155401] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.155792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.155792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.155792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.155957] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.156219] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.156219] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.156360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.156360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.156434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.156781] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.156781] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.156920] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.157115] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.157211] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.157311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.157372] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.157829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.157829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.157947] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.158040] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.252159] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 in Status: SUCCESS [ 1001.252420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.373423] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.373423] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.373423] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.373423] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.373423] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.373423] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 already deleted. [ 1001.373682] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.373989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.374159] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.374944] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e086b64-be51-49af-ac2c-6312cfa54bf4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.472793] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.473921] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.473921] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.473921] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.473921] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.474158] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port af2d617c-7a43-466f-b19d-3cce0c52c836 not found, creating... [ 1001.477429] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.477720] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.477952] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.478334] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.478586] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.478956] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.479139] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.479263] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.479507] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.479655] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.479816] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: af2d617c-7a43-466f-b19d-3cce0c52c836 is going to be created. [ 1001.510271] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.510865] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.511157] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.511518] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.511963] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.512271] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-af2d617c-7a43-466f-b19d-3cce0c52c836" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.662827] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fdaff9b-63be-497c-8622-3160e739856a: rpc.has_security_group_logging(os_id): False [ 1001.688042] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.688042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.688042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.688042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.688042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.688042] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.688042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.688042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.688042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.688042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.688042] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.688042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.688042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.688042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.688042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.688794] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.688794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.688794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.688794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.688794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.691711] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be updated. [ 1001.786677] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.786677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.786822] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.786949] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.787113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.805151] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: IN_PROGRESS for 2s [ 1001.902301] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.902569] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.902724] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.903293] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.903512] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.903748] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 already deleted. [ 1001.903936] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.929715] env[69920]: INFO networking_nsxv3.common.synchronization [None req-08ef32e5-3cbe-45c7-b9c5-178c20b953aa None None] Enqueued Resource ID: d6109eea-a6ba-430c-b890-dd92d58d42b5 with Priority: HIGHEST for action port [ 1001.930517] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6109eea-a6ba-430c-b890-dd92d58d42b5 with Priority: HIGHEST for action port [ 1001.931036] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6109eea-a6ba-430c-b890-dd92d58d42b5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.931237] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6109eea-a6ba-430c-b890-dd92d58d42b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.931433] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6109eea-a6ba-430c-b890-dd92d58d42b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.931733] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6109eea-a6ba-430c-b890-dd92d58d42b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.931853] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6109eea-a6ba-430c-b890-dd92d58d42b5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.961236] env[69920]: INFO networking_nsxv3.common.synchronization [req-5e029f6e-c0bd-42ea-97bc-e0e6d418b90a req-3147f97b-2fc0-4b25-9be6-2aaad9d89f5b tempest-AttachInterfacesV270Test-499421490 tempest-AttachInterfacesV270Test-499421490-project-member] Enqueued Resource ID: 0e59b5ff-c965-44e5-b635-07a76f775de9 with Priority: HIGHEST for action security_group_members [ 1001.961810] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e59b5ff-c965-44e5-b635-07a76f775de9 with Priority: HIGHEST for action security_group_members [ 1001.962448] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e59b5ff-c965-44e5-b635-07a76f775de9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.964950] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.965093] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.965340] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.965543] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.965670] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.965739] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.965919] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.966044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.966165] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e59b5ff-c965-44e5-b635-07a76f775de9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.998239] env[69920]: INFO networking_nsxv3.common.synchronization [req-46d05cda-10b2-427b-adad-58d42874e01f req-dacde181-0c2a-48e3-a461-396c9582ada5 tempest-MigrationsAdminTest-685805879 tempest-MigrationsAdminTest-685805879-project-member] Enqueued Resource ID: 6440e2db-5336-4fd7-b450-468fa8f78560 with Priority: HIGHEST for action security_group_members [ 1001.999038] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6440e2db-5336-4fd7-b450-468fa8f78560 with Priority: HIGHEST for action security_group_members [ 1001.999424] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6440e2db-5336-4fd7-b450-468fa8f78560 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.999583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.999657] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.999868] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.000027] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.000127] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.000191] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.000337] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.000422] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.000516] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6440e2db-5336-4fd7-b450-468fa8f78560',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.437538] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d6109eea-a6ba-430c-b890-dd92d58d42b5 [ 1002.437538] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.438051] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.438051] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.438051] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.438051] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.438246] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d6109eea-a6ba-430c-b890-dd92d58d42b5 already deleted. [ 1002.438246] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6109eea-a6ba-430c-b890-dd92d58d42b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.468400] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.468587] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.468641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.468854] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.469018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.469160] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.469257] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.469309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.469467] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.469538] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.469628] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e59b5ff-c965-44e5-b635-07a76f775de9 is going to be updated. [ 1002.499418] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.500290] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.500380] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.500575] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.500728] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.502485] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6440e2db-5336-4fd7-b450-468fa8f78560',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.512144] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e59b5ff-c965-44e5-b635-07a76f775de9 in Status: IN_PROGRESS for 2s [ 1002.606889] env[69920]: INFO networking_nsxv3.common.synchronization [req-1449223b-d767-473c-afe2-b9d5a7bc7cf5 req-6ace47ec-da40-40e2-8811-16d2ed736e14 service nova] Enqueued Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_rules [ 1002.607122] env[69920]: INFO networking_nsxv3.common.synchronization [req-1449223b-d767-473c-afe2-b9d5a7bc7cf5 req-6ace47ec-da40-40e2-8811-16d2ed736e14 service nova] Enqueued Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_members [ 1002.607272] env[69920]: INFO networking_nsxv3.common.synchronization [req-1449223b-d767-473c-afe2-b9d5a7bc7cf5 req-6ace47ec-da40-40e2-8811-16d2ed736e14 service nova] Enqueued Resource ID: af2d617c-7a43-466f-b19d-3cce0c52c836 with Priority: HIGHEST for action port [ 1002.608537] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_rules [ 1002.608683] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_members [ 1002.608781] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af2d617c-7a43-466f-b19d-3cce0c52c836 with Priority: HIGHEST for action port [ 1002.609089] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.609214] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.609275] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.609477] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.609559] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.610921] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.614106] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.614106] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.614106] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.614106] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.614106] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.614106] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.614106] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.614106] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.614106] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.614106] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-af2d617c-7a43-466f-b19d-3cce0c52c836 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.614106] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af2d617c-7a43-466f-b19d-3cce0c52c836" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.614106] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af2d617c-7a43-466f-b19d-3cce0c52c836" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.614106] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af2d617c-7a43-466f-b19d-3cce0c52c836" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.614106] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af2d617c-7a43-466f-b19d-3cce0c52c836',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.629095] env[69920]: INFO networking_nsxv3.common.synchronization [req-d30759a9-9f1a-4c06-bbd6-1c300aac6e4a req-14e3bd08-e599-453e-82fd-ae692f6e5710 tempest-InstanceActionsTestJSON-1460553136 tempest-InstanceActionsTestJSON-1460553136-project-member] Enqueued Resource ID: 287306e2-c53f-4a5f-82ab-b97a6d8f9e37 with Priority: HIGHEST for action security_group_members [ 1002.629560] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287306e2-c53f-4a5f-82ab-b97a6d8f9e37 with Priority: HIGHEST for action security_group_members [ 1002.629854] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.629986] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.630559] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.630841] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.630950] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.631057] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.631057] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.631247] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.631299] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.631373] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('287306e2-c53f-4a5f-82ab-b97a6d8f9e37',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.004955] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6440e2db-5336-4fd7-b450-468fa8f78560',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.049074] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 in Status: SUCCESS [ 1003.049074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.049074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.049074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.049074] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.049074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.049074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.049074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.049074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.049074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.049074] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1780a9d7-a751-45c5-b020-85c8fdadacd9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.115040] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.119403] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.119403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.119403] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af2d617c-7a43-466f-b19d-3cce0c52c836 with status ACTIVE [ 1003.119403] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.119403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.119403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.119403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.119403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.119403] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.119403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.119403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.119403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.119975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.119975] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.119975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.119975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.119975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.120185] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.120185] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af2d617c-7a43-466f-b19d-3cce0c52c836 is going to be updated. [ 1003.133460] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.133633] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.133706] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.133912] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.134012] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.134209] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.134303] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.134377] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.134534] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.134603] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.134690] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 287306e2-c53f-4a5f-82ab-b97a6d8f9e37 is going to be updated. [ 1003.147201] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.147201] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.147201] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.147463] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.147463] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.147714] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af2d617c-7a43-466f-b19d-3cce0c52c836" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.183753] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.183753] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.183753] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.183753] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.183753] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.194815] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287306e2-c53f-4a5f-82ab-b97a6d8f9e37 in Status: IN_PROGRESS for 2s [ 1003.507852] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.508316] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.508316] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.508316] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.508490] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.508490] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6440e2db-5336-4fd7-b450-468fa8f78560 is going to be updated. [ 1003.538691] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.538948] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.539048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.539270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.539423] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.548778] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6440e2db-5336-4fd7-b450-468fa8f78560 in Status: IN_PROGRESS for 2s [ 1003.552278] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1780a9d7-a751-45c5-b020-85c8fdadacd9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.622571] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.822214] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: SUCCESS [ 1003.822426] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.986793] env[69920]: INFO networking_nsxv3.common.synchronization [req-8c704f94-0de1-44de-8caf-833790d77432 req-287605c8-e4bf-4ae9-ac3f-4ffce712d34e tempest-ServersTestMultiNic-1807665099 tempest-ServersTestMultiNic-1807665099-project-member] Enqueued Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 1003.987490] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 1003.987884] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.988089] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.988162] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.988315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.988464] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.988559] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.988621] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.988769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.988857] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.988952] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.056771] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1780a9d7-a751-45c5-b020-85c8fdadacd9: rpc.has_security_group_logging(os_id): False [ 1004.078640] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.078640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.078640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.078640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.078927] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.078974] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.079063] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.079166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.079280] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.079359] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.079455] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 is going to be created. [ 1004.126298] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.126562] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.126562] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.126803] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.126947] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.127070] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b is going to be created. [ 1004.144191] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.144191] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.144191] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.144191] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.144191] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.156734] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.156894] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.156988] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.157216] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.157347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.162627] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 in Status: IN_PROGRESS for 2s [ 1004.183057] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: UNINITIALIZED for 2s [ 1004.346595] env[69920]: INFO networking_nsxv3.common.synchronization [req-8c704f94-0de1-44de-8caf-833790d77432 req-317a5b68-4a6a-4758-8bb4-fd9adb5ae4a4 tempest-ServersTestMultiNic-1807665099 tempest-ServersTestMultiNic-1807665099-project-member] Enqueued Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 1004.347562] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 1004.347952] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.348096] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.494625] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.494887] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.495205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.495302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.522591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.522591] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.522591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.522591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.522591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.522591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.522591] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 is going to be updated. [ 1004.527411] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e59b5ff-c965-44e5-b635-07a76f775de9 in Status: SUCCESS [ 1004.527712] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e59b5ff-c965-44e5-b635-07a76f775de9 deletion is rescheduled due to dependency. [ 1004.527822] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.557458] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.557697] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.558380] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.558380] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.558380] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.568676] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: IN_PROGRESS for 2s [ 1004.776514] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-290 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.776787] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-290" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.776920] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-290" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.777794] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-290" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.782507] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.782507] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.782507] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.782507] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.782507] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.782507] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1004.782507] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.782507] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.782507] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.782507] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1004.782507] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.782507] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.802735] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.803016] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1004.803203] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.803395] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-290" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.803765] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-4c8ce9d5-2863-409f-9eb4-7e69c28015e7 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.804014] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-4c8ce9d5-2863-409f-9eb4-7e69c28015e7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.804185] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-4c8ce9d5-2863-409f-9eb4-7e69c28015e7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.804510] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-4c8ce9d5-2863-409f-9eb4-7e69c28015e7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.804656] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c8ce9d5-2863-409f-9eb4-7e69c28015e7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.206593] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287306e2-c53f-4a5f-82ab-b97a6d8f9e37 in Status: SUCCESS [ 1005.206836] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 287306e2-c53f-4a5f-82ab-b97a6d8f9e37 deletion is rescheduled due to dependency. [ 1005.206950] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287306e2-c53f-4a5f-82ab-b97a6d8f9e37" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.309564] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.309946] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.310194] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.311129] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.311129] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.312087] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 4c8ce9d5-2863-409f-9eb4-7e69c28015e7 not found, creating... [ 1005.312460] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.312655] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.312773] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.313196] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.313353] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.313676] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.313839] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.313960] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.314216] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.314386] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.314649] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 4c8ce9d5-2863-409f-9eb4-7e69c28015e7 is going to be created. [ 1005.336463] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.336698] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.336831] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.337148] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.337414] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.337662] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-4c8ce9d5-2863-409f-9eb4-7e69c28015e7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.560952] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6440e2db-5336-4fd7-b450-468fa8f78560 in Status: SUCCESS [ 1005.561276] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.045545] env[69920]: INFO networking_nsxv3.common.synchronization [req-8c704f94-0de1-44de-8caf-833790d77432 req-7b86190d-a06b-40fe-8ce2-2bd44f986192 service nova] Enqueued Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_rules [ 1006.045545] env[69920]: INFO networking_nsxv3.common.synchronization [req-8c704f94-0de1-44de-8caf-833790d77432 req-7b86190d-a06b-40fe-8ce2-2bd44f986192 service nova] Enqueued Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 1006.045545] env[69920]: INFO networking_nsxv3.common.synchronization [req-8c704f94-0de1-44de-8caf-833790d77432 req-7b86190d-a06b-40fe-8ce2-2bd44f986192 service nova] Enqueued Resource ID: 4c8ce9d5-2863-409f-9eb4-7e69c28015e7 with Priority: HIGHEST for action port [ 1006.045740] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_rules [ 1006.045989] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 1006.045989] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c8ce9d5-2863-409f-9eb4-7e69c28015e7 with Priority: HIGHEST for action port [ 1006.046370] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.046510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.046562] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.046784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.048112] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.048112] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.048112] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.048112] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c8ce9d5-2863-409f-9eb4-7e69c28015e7 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.050439] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c8ce9d5-2863-409f-9eb4-7e69c28015e7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.050439] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c8ce9d5-2863-409f-9eb4-7e69c28015e7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.050439] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c8ce9d5-2863-409f-9eb4-7e69c28015e7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.050439] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c8ce9d5-2863-409f-9eb4-7e69c28015e7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.175109] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 in Status: SUCCESS [ 1006.175397] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.194076] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: SUCCESS [ 1006.194208] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.194420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.194935] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.195216] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.195344] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.195414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.195702] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.195794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.195913] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.199650] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.550250] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.550421] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.550648] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c8ce9d5-2863-409f-9eb4-7e69c28015e7 with status ACTIVE [ 1006.550764] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.550845] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.550916] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.551158] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.551248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.551418] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.551579] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.551579] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.551728] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.551804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.551985] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.552124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.552156] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.552279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.552352] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.552438] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c8ce9d5-2863-409f-9eb4-7e69c28015e7 is going to be updated. [ 1006.581119] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: SUCCESS [ 1006.581507] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 deletion is rescheduled due to dependency. [ 1006.581748] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.582195] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.582566] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.582997] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.583205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.583316] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.583572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.583720] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.583948] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.586380] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.586515] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.586649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.587648] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.587729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.587905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c8ce9d5-2863-409f-9eb4-7e69c28015e7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.702554] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.860667] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-917 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.860667] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-917" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.864438] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-917" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.864438] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-917" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.864438] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.864438] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.864438] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.864438] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.864438] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.864438] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1006.864438] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1006.864438] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1006.864438] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1006.864438] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1006.864438] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1006.864438] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1006.885399] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1006.886278] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1006.886278] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1006.886278] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-917" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.886450] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-802f8075-d76e-4020-be35-7cbf0f84fc4a taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.886650] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-802f8075-d76e-4020-be35-7cbf0f84fc4a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.886694] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-802f8075-d76e-4020-be35-7cbf0f84fc4a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.887671] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-802f8075-d76e-4020-be35-7cbf0f84fc4a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.887671] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('802f8075-d76e-4020-be35-7cbf0f84fc4a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.089596] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.208041] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ae58702-5520-4afd-abbd-064c34515d9b: rpc.has_security_group_logging(os_id): False [ 1007.226165] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.226483] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.226483] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.226699] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.226861] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.227113] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.227209] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.227292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.227512] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.227704] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.227704] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b is going to be created. [ 1007.292458] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.292690] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.292690] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.292975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.293242] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.310068] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: IN_PROGRESS for 2s [ 1007.390923] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.390923] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.392071] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.392071] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.392071] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.392071] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 802f8075-d76e-4020-be35-7cbf0f84fc4a not found, creating... [ 1007.392280] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.392280] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.392439] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.393148] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.393148] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.393416] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.393416] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.393517] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.393685] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.393814] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.393999] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 802f8075-d76e-4020-be35-7cbf0f84fc4a is going to be created. [ 1007.420846] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.421237] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.421358] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.421650] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.422196] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.422358] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-802f8075-d76e-4020-be35-7cbf0f84fc4a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.591328] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.098809] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.098809] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.098809] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.098809] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.098809] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.098809] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 is going to be updated. [ 1008.137243] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.137243] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.137364] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.137619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.138412] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.151101] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: IN_PROGRESS for 2s [ 1008.179572] env[69920]: INFO networking_nsxv3.common.synchronization [req-8c704f94-0de1-44de-8caf-833790d77432 req-9d96c430-fadd-4534-a02e-078dfd679ca4 service nova] Enqueued Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_rules [ 1008.179827] env[69920]: INFO networking_nsxv3.common.synchronization [req-8c704f94-0de1-44de-8caf-833790d77432 req-9d96c430-fadd-4534-a02e-078dfd679ca4 service nova] Enqueued Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 1008.180089] env[69920]: INFO networking_nsxv3.common.synchronization [req-8c704f94-0de1-44de-8caf-833790d77432 req-9d96c430-fadd-4534-a02e-078dfd679ca4 service nova] Enqueued Resource ID: 802f8075-d76e-4020-be35-7cbf0f84fc4a with Priority: HIGHEST for action port [ 1008.180788] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_rules [ 1008.181314] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 1008.181534] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 802f8075-d76e-4020-be35-7cbf0f84fc4a with Priority: HIGHEST for action port [ 1008.182600] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.182756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.183031] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.183179] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.183390] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-802f8075-d76e-4020-be35-7cbf0f84fc4a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.183558] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-802f8075-d76e-4020-be35-7cbf0f84fc4a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.183649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-802f8075-d76e-4020-be35-7cbf0f84fc4a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.183920] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-802f8075-d76e-4020-be35-7cbf0f84fc4a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.184066] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('802f8075-d76e-4020-be35-7cbf0f84fc4a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.687577] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 802f8075-d76e-4020-be35-7cbf0f84fc4a with status ACTIVE [ 1008.688487] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.688705] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.689271] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.689271] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.689271] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.689524] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.689722] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.693122] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.693871] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.693871] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.693871] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.694053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.694053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.694284] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.694516] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.694600] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 802f8075-d76e-4020-be35-7cbf0f84fc4a is going to be updated. [ 1008.718029] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.718345] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.718572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.718733] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.718918] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.719169] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-802f8075-d76e-4020-be35-7cbf0f84fc4a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.325207] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: SUCCESS [ 1009.325207] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.023957] env[69920]: INFO networking_nsxv3.common.synchronization [req-5f51393f-9b59-4f1e-8a81-d9ff8dc80f6d req-98051139-704c-487e-88e8-7757b564321a tempest-AttachVolumeTestJSON-218421131 tempest-AttachVolumeTestJSON-218421131-project-member] Enqueued Resource ID: 225fb705-337d-4abe-9a25-de3a33d5a961 with Priority: HIGHEST for action security_group_members [ 1010.024552] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 225fb705-337d-4abe-9a25-de3a33d5a961 with Priority: HIGHEST for action security_group_members [ 1010.024998] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-225fb705-337d-4abe-9a25-de3a33d5a961 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.024998] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.026679] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.027133] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.027324] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.027441] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.027536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.027773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.027888] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.028009] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('225fb705-337d-4abe-9a25-de3a33d5a961',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.167339] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: SUCCESS [ 1010.169024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.169024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.169024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.170138] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.170138] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.170138] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.171766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.171766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.171766] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.384847] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-269 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.385058] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-269" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.385192] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-269" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.385465] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-269" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.385720] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.385879] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.385999] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.386507] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.386758] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.386917] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1010.387907] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1010.387907] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1010.387907] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1010.387907] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1010.388103] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1010.388193] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1010.406825] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1010.407019] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1010.407169] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1010.407354] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-269" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.407694] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-0083dc02-3370-427b-bd94-c2267d234d68 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.407880] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-0083dc02-3370-427b-bd94-c2267d234d68" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.408015] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-0083dc02-3370-427b-bd94-c2267d234d68" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.408348] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-0083dc02-3370-427b-bd94-c2267d234d68" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.408515] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0083dc02-3370-427b-bd94-c2267d234d68',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.530510] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.530666] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.530742] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.530960] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.531072] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.531284] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.531385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.531447] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.531608] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.531692] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.531783] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 225fb705-337d-4abe-9a25-de3a33d5a961 already deleted. [ 1010.531864] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.632942] env[69920]: INFO networking_nsxv3.common.synchronization [req-600fdf42-cd53-4bbe-a2d4-05ff0505b496 req-5afe8c32-26c7-48cb-a400-a133455d8268 tempest-ServersAdminNegativeTestJSON-439752242 tempest-ServersAdminNegativeTestJSON-439752242-project-member] Enqueued Resource ID: 33cfaadf-9929-4bc4-a275-43f890595f10 with Priority: HIGHEST for action security_group_members [ 1010.633511] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33cfaadf-9929-4bc4-a275-43f890595f10 with Priority: HIGHEST for action security_group_members [ 1010.633831] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-33cfaadf-9929-4bc4-a275-43f890595f10 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.633952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.636622] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.636622] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.636841] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.636841] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.636949] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.637857] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.637857] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.637857] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33cfaadf-9929-4bc4-a275-43f890595f10',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.673240] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.911364] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.911364] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.911528] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.911718] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.911877] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.912046] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 0083dc02-3370-427b-bd94-c2267d234d68 not found, creating... [ 1010.912383] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.912561] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.913133] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.913133] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.913133] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.913399] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.913590] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.913855] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.913947] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.914083] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.914233] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 0083dc02-3370-427b-bd94-c2267d234d68 is going to be created. [ 1010.935476] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.935476] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.935619] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.935792] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.936043] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.936288] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-0083dc02-3370-427b-bd94-c2267d234d68" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.141582] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33cfaadf-9929-4bc4-a275-43f890595f10',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.180214] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.645515] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33cfaadf-9929-4bc4-a275-43f890595f10',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.682839] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.683298] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.683453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.683701] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.683812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.683967] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 is going to be updated. [ 1011.733782] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.733782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.733782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.733782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.733782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.748207] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: IN_PROGRESS for 2s [ 1011.793024] env[69920]: INFO networking_nsxv3.common.synchronization [req-5f51393f-9b59-4f1e-8a81-d9ff8dc80f6d req-ce49aaf5-257c-4b2e-bcb6-1e986addc589 service nova] Enqueued Resource ID: 225fb705-337d-4abe-9a25-de3a33d5a961 with Priority: HIGHEST for action security_group_rules [ 1011.793024] env[69920]: INFO networking_nsxv3.common.synchronization [req-5f51393f-9b59-4f1e-8a81-d9ff8dc80f6d req-ce49aaf5-257c-4b2e-bcb6-1e986addc589 service nova] Enqueued Resource ID: 225fb705-337d-4abe-9a25-de3a33d5a961 with Priority: HIGHEST for action security_group_members [ 1011.793024] env[69920]: INFO networking_nsxv3.common.synchronization [req-5f51393f-9b59-4f1e-8a81-d9ff8dc80f6d req-ce49aaf5-257c-4b2e-bcb6-1e986addc589 service nova] Enqueued Resource ID: 0083dc02-3370-427b-bd94-c2267d234d68 with Priority: HIGHEST for action port [ 1011.793024] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 225fb705-337d-4abe-9a25-de3a33d5a961 with Priority: HIGHEST for action security_group_rules [ 1011.793024] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 225fb705-337d-4abe-9a25-de3a33d5a961 with Priority: HIGHEST for action security_group_members [ 1011.793024] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0083dc02-3370-427b-bd94-c2267d234d68 with Priority: HIGHEST for action port [ 1011.793024] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-225fb705-337d-4abe-9a25-de3a33d5a961 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.793024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.793024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.794302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.794680] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('225fb705-337d-4abe-9a25-de3a33d5a961',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.798025] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-225fb705-337d-4abe-9a25-de3a33d5a961 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.798025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.798025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.798025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.798025] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.798025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.798025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.798025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.798025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.798025] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('225fb705-337d-4abe-9a25-de3a33d5a961',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.803053] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-0083dc02-3370-427b-bd94-c2267d234d68 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.803053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0083dc02-3370-427b-bd94-c2267d234d68" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.803053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0083dc02-3370-427b-bd94-c2267d234d68" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.803053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0083dc02-3370-427b-bd94-c2267d234d68" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.803053] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0083dc02-3370-427b-bd94-c2267d234d68',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.148101] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.148488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.148488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.148583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.148714] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.148794] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33cfaadf-9929-4bc4-a275-43f890595f10 is going to be updated. [ 1012.183195] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.183368] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.183413] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.183623] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.183769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.208422] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33cfaadf-9929-4bc4-a275-43f890595f10 in Status: IN_PROGRESS for 2s [ 1012.302913] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('225fb705-337d-4abe-9a25-de3a33d5a961',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.304063] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-225fb705-337d-4abe-9a25-de3a33d5a961 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.304182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.304518] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0083dc02-3370-427b-bd94-c2267d234d68 with status ACTIVE [ 1012.304518] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.304688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.304727] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.304957] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.305071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.305356] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.305502] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.305590] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.305772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.305927] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.306213] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.306423] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.306423] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.306588] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.306691] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.306788] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0083dc02-3370-427b-bd94-c2267d234d68 is going to be updated. [ 1012.332033] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.332217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.332217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.332404] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.332541] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.332815] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0083dc02-3370-427b-bd94-c2267d234d68" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.808773] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('225fb705-337d-4abe-9a25-de3a33d5a961',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.312144] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.312488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.312488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.312677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.312794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.312941] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 225fb705-337d-4abe-9a25-de3a33d5a961 is going to be created. [ 1013.345980] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.346175] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.346223] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.346462] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.346587] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.358196] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 225fb705-337d-4abe-9a25-de3a33d5a961 in Status: UNINITIALIZED for 2s [ 1013.759935] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: SUCCESS [ 1013.760226] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.760436] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.760747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.761010] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.761145] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.761212] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.761379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.761465] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.761551] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.761719] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.763064] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.763064] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.763226] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.763345] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.763443] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.763662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.763841] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.763934] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.225340] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33cfaadf-9929-4bc4-a275-43f890595f10 in Status: SUCCESS [ 1014.225340] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.267562] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.267562] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.267562] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.768920] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.271583] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.271884] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.271973] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.272297] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.272671] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.272839] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 is going to be updated. [ 1015.307235] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.307437] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.307487] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.307673] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.307842] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.323368] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: IN_PROGRESS for 2s [ 1015.368743] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 225fb705-337d-4abe-9a25-de3a33d5a961 in Status: SUCCESS [ 1015.369151] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.369347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.369783] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.369994] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.370162] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.370245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.370848] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.370848] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.370848] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.370848] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('225fb705-337d-4abe-9a25-de3a33d5a961',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.873460] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('225fb705-337d-4abe-9a25-de3a33d5a961',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.376769] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 225fb705-337d-4abe-9a25-de3a33d5a961: rpc.has_security_group_logging(os_id): False [ 1016.395938] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.395938] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.396094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.396199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.396292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.396535] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.396634] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.396766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.396929] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.397017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.397108] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 225fb705-337d-4abe-9a25-de3a33d5a961 is going to be created. [ 1016.466876] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.466876] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.466876] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.466876] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.467176] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.481368] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 225fb705-337d-4abe-9a25-de3a33d5a961 in Status: IN_PROGRESS for 2s [ 1016.793773] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1016.794019] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1017.342254] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: SUCCESS [ 1017.342647] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.342803] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.343055] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.343259] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.343610] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.343707] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.344013] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.344097] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.344198] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.344382] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.344484] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.344547] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.344803] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.344962] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.345084] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.345153] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.345311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.345395] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.345482] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.345722] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.848612] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7aae69a5-1701-43e9-9978-86df7a832270: rpc.has_security_group_logging(os_id): False [ 1017.870862] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.871239] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.871303] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.871555] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.871685] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.871897] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.872056] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.872170] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.872344] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.872425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.872652] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.872746] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.872810] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.872955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.873112] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.873500] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.873607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.873683] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.874844] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.874844] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.874844] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 is going to be updated. [ 1017.957508] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.957751] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.957868] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.958121] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.958287] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.974366] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: IN_PROGRESS for 2s [ 1018.497040] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 225fb705-337d-4abe-9a25-de3a33d5a961 in Status: SUCCESS [ 1018.497477] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.690602] env[69920]: INFO networking_nsxv3.common.synchronization [req-993541db-c890-40c8-85ea-9b2a8228979d req-c09163e6-df6a-484a-b85e-f0b10c1d39aa tempest-ServersAdminTestJSON-859816448 tempest-ServersAdminTestJSON-859816448-project-member] Enqueued Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 1019.691454] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 1019.691588] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.691744] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.691834] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.692273] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.692484] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.692932] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.692932] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.692932] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.693160] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.693210] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.992698] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: SUCCESS [ 1019.995298] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.995298] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.995298] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.995298] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.198459] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.496699] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.496955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.497053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.497310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.497491] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.497638] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.497723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.497895] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.498008] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.498105] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.498196] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.702812] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.005670] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.006836] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.009460] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.009460] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.009460] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.009460] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.009460] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.009773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.009773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.009773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.009896] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.009984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.010365] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.010571] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.010739] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.010999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.010999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.011138] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.011182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.011286] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.011420] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.205504] env[69920]: INFO networking_nsxv3.common.synchronization [req-a4e57c96-b9f5-437b-bdda-ff554412a6e1 req-b625347c-9d91-4349-b6cd-dcf34587967e tempest-ServersTestMultiNic-1807665099 tempest-ServersTestMultiNic-1807665099-project-member] Enqueued Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 1021.206056] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 1021.206373] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.206497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.206565] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.206797] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.206955] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.207244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.207244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.208721] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.208721] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.208721] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.213337] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.213337] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.213337] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.213337] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.213337] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.213337] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a is going to be updated. [ 1021.244544] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.244908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.244984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.245276] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.245684] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.257953] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: IN_PROGRESS for 2s [ 1021.515417] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7aae69a5-1701-43e9-9978-86df7a832270: rpc.has_security_group_logging(os_id): False [ 1021.541024] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.541024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.541024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.541024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.541024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.541024] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.541024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.541024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.541024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.541024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.541024] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.541024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.541024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.541024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.541024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.541846] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.541846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.541846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.541846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.541846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.541846] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 is going to be updated. [ 1021.571744] env[69920]: INFO networking_nsxv3.common.synchronization [req-a4e57c96-b9f5-437b-bdda-ff554412a6e1 req-f1564302-ea4d-4087-b1df-d15f734ffff4 tempest-ServersTestMultiNic-1807665099 tempest-ServersTestMultiNic-1807665099-project-member] Enqueued Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 1021.572200] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGHEST for action security_group_members [ 1021.572533] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.572641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.616896] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.617077] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.617145] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.617329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.617482] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.637127] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: IN_PROGRESS for 2s [ 1021.715395] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.219433] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.723131] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.723431] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.723431] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.723612] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.723713] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.723810] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 is going to be updated. [ 1022.756871] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.757053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.757140] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.757344] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.757484] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.767147] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: IN_PROGRESS for 2s [ 1023.268732] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: SUCCESS [ 1023.269709] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.659420] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: SUCCESS [ 1023.659420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.779168] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: SUCCESS [ 1024.779414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.779797] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.779797] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.780030] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.780030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.780030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.780194] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.780240] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.780332] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.284011] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.284233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.284319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.284594] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.285369] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.285734] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.285861] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.286039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.286656] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.286957] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.287113] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 is going to be updated. [ 1025.314550] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.314837] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.314932] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.315237] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.315426] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.326147] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: IN_PROGRESS for 2s [ 1025.787562] env[69920]: INFO networking_nsxv3.common.synchronization [req-7cff6c9d-93b3-42d8-93eb-f29f203a7583 req-2f133769-9ccf-4ac4-a76f-423ed97a89f8 tempest-ImagesTestJSON-210893687 tempest-ImagesTestJSON-210893687-project-member] Enqueued Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 1025.788315] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 1025.788824] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.788824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.788824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.789029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.789680] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.789786] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.789786] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.789941] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.790039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.790145] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.961988] env[69920]: INFO networking_nsxv3.common.synchronization [None req-d38bebd5-310f-46c5-b123-24bbed9afb08 None None] Enqueued Resource ID: fa84ebc0-cde1-42d7-9819-de31926e2b14 with Priority: HIGHEST for action port [ 1025.962298] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa84ebc0-cde1-42d7-9819-de31926e2b14 with Priority: HIGHEST for action port [ 1025.962919] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa84ebc0-cde1-42d7-9819-de31926e2b14 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.963251] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa84ebc0-cde1-42d7-9819-de31926e2b14" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.963428] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa84ebc0-cde1-42d7-9819-de31926e2b14" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.963754] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa84ebc0-cde1-42d7-9819-de31926e2b14" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.963859] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa84ebc0-cde1-42d7-9819-de31926e2b14',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.294676] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.323021] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-203 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.323266] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-203" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.323373] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-203" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.323652] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-203" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.323916] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.324095] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.324227] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.324455] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.324607] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.324833] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1026.324948] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1026.325078] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1026.325288] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1026.325355] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1026.325498] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1026.325579] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1026.348592] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1026.348777] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1026.348920] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1026.349119] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-203" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.349553] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-1d1a9d58-33a0-4ef9-b472-1e66ed5b0450 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.350103] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-1d1a9d58-33a0-4ef9-b472-1e66ed5b0450" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.350269] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-1d1a9d58-33a0-4ef9-b472-1e66ed5b0450" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.350639] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-1d1a9d58-33a0-4ef9-b472-1e66ed5b0450" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.350792] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d1a9d58-33a0-4ef9-b472-1e66ed5b0450',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.470486] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fa84ebc0-cde1-42d7-9819-de31926e2b14 [ 1026.470486] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.470486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.470486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.470486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.470486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.470486] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fa84ebc0-cde1-42d7-9819-de31926e2b14 already deleted. [ 1026.470486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa84ebc0-cde1-42d7-9819-de31926e2b14" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.799460] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.853677] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.854026] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.854092] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.854376] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.854533] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.854706] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 1d1a9d58-33a0-4ef9-b472-1e66ed5b0450 not found, creating... [ 1026.855016] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.855149] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.855337] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.855495] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.855642] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.855933] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.856211] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.856353] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.856571] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.856714] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.856920] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 1d1a9d58-33a0-4ef9-b472-1e66ed5b0450 is going to be created. [ 1026.877412] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.877636] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.877779] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.878119] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.878676] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.878676] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-1d1a9d58-33a0-4ef9-b472-1e66ed5b0450" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.302055] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.306030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.306030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.306030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.306030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.306030] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 is going to be updated. [ 1027.340582] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aae69a5-1701-43e9-9978-86df7a832270 in Status: SUCCESS [ 1027.340808] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 deletion is rescheduled due to dependency. [ 1027.340937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.342010] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.344908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.344908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.344908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.344908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.351655] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: IN_PROGRESS for 2s [ 1027.775946] env[69920]: INFO networking_nsxv3.common.synchronization [req-7cff6c9d-93b3-42d8-93eb-f29f203a7583 req-f35e37ac-e8e0-45a5-9294-7f43eb047b0e service nova] Enqueued Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_rules [ 1027.776166] env[69920]: INFO networking_nsxv3.common.synchronization [req-7cff6c9d-93b3-42d8-93eb-f29f203a7583 req-f35e37ac-e8e0-45a5-9294-7f43eb047b0e service nova] Enqueued Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 1027.776312] env[69920]: INFO networking_nsxv3.common.synchronization [req-7cff6c9d-93b3-42d8-93eb-f29f203a7583 req-f35e37ac-e8e0-45a5-9294-7f43eb047b0e service nova] Enqueued Resource ID: 1d1a9d58-33a0-4ef9-b472-1e66ed5b0450 with Priority: HIGHEST for action port [ 1027.776549] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_rules [ 1027.776677] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 1027.776790] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d1a9d58-33a0-4ef9-b472-1e66ed5b0450 with Priority: HIGHEST for action port [ 1027.777930] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.777991] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.778491] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.778717] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.778808] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.779974] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.779974] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.779974] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d1a9d58-33a0-4ef9-b472-1e66ed5b0450 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.780189] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d1a9d58-33a0-4ef9-b472-1e66ed5b0450" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.780189] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d1a9d58-33a0-4ef9-b472-1e66ed5b0450" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.780329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d1a9d58-33a0-4ef9-b472-1e66ed5b0450" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.780405] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d1a9d58-33a0-4ef9-b472-1e66ed5b0450',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.286029] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.286029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.286029] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d1a9d58-33a0-4ef9-b472-1e66ed5b0450 with status ACTIVE [ 1028.286029] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.286029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.286029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.286029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.286029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.286029] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.286029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.286029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.286029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.286029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.286029] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.287095] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.287095] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.287095] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.287095] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.287095] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d1a9d58-33a0-4ef9-b472-1e66ed5b0450 is going to be updated. [ 1028.332438] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.332649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.332649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.332938] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.333045] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.333133] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d1a9d58-33a0-4ef9-b472-1e66ed5b0450" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.372923] env[69920]: INFO networking_nsxv3.common.synchronization [None req-beebd26d-d2b4-4e5f-bf2d-f49c441c7ddb None None] Enqueued Resource ID: 9173b97e-2c7e-4189-8da4-9bb8805ca0f1 with Priority: HIGHEST for action port [ 1028.373192] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9173b97e-2c7e-4189-8da4-9bb8805ca0f1 with Priority: HIGHEST for action port [ 1028.373750] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-9173b97e-2c7e-4189-8da4-9bb8805ca0f1 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.373875] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9173b97e-2c7e-4189-8da4-9bb8805ca0f1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.373994] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9173b97e-2c7e-4189-8da4-9bb8805ca0f1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.374277] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9173b97e-2c7e-4189-8da4-9bb8805ca0f1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.374328] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9173b97e-2c7e-4189-8da4-9bb8805ca0f1',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.596071] env[69920]: INFO networking_nsxv3.common.synchronization [req-b9782057-fdc4-422d-9532-0d63dac69b63 req-0e275941-203b-4785-ac29-8152d84938af tempest-ServersWithSpecificFlavorTestJSON-1780415271 tempest-ServersWithSpecificFlavorTestJSON-1780415271-project-member] Enqueued Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGHEST for action security_group_members [ 1028.596670] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGHEST for action security_group_members [ 1028.597022] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-81b4d229-34c1-420c-acac-a5e9d44d33e5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.598428] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.599319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.599642] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.601677] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.601677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.601677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.601677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.601677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.601677] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81b4d229-34c1-420c-acac-a5e9d44d33e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.877769] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9173b97e-2c7e-4189-8da4-9bb8805ca0f1 [ 1028.878302] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.879071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.880039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.880321] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.880512] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.880609] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9173b97e-2c7e-4189-8da4-9bb8805ca0f1 already deleted. [ 1028.880724] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9173b97e-2c7e-4189-8da4-9bb8805ca0f1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.104525] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.104525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.104525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.104525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.104525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.104525] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.104525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.104525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.104525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.104525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.104525] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 already deleted. [ 1029.104525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.131994] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-336 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.131994] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-336" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.131994] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-336" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.131994] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-336" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.131994] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.131994] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.133121] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.133403] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.133564] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.133789] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1029.133999] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1029.134060] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1029.134157] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1029.134280] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1029.134395] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1029.134538] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1029.156622] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1029.156872] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1029.157028] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1029.157385] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-336" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.157857] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-8c5792b5-80a0-4414-bb3b-ae6e25874202 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.158171] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-8c5792b5-80a0-4414-bb3b-ae6e25874202" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.158400] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-8c5792b5-80a0-4414-bb3b-ae6e25874202" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.158871] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-8c5792b5-80a0-4414-bb3b-ae6e25874202" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.159120] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c5792b5-80a0-4414-bb3b-ae6e25874202',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.363364] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: SUCCESS [ 1029.363666] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.363795] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.364028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.364248] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.364371] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.364438] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.364609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.364791] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.364902] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.662832] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.663153] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.663324] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.663704] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.663954] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.664155] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 8c5792b5-80a0-4414-bb3b-ae6e25874202 not found, creating... [ 1029.664504] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.664852] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.665050] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.665373] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.665555] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.665970] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.666203] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.666394] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.666670] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.666907] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.667103] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 8c5792b5-80a0-4414-bb3b-ae6e25874202 is going to be created. [ 1029.688330] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.688552] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.688683] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.689087] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.689375] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.689647] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-8c5792b5-80a0-4414-bb3b-ae6e25874202" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.868424] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.372522] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.830458] env[69920]: INFO networking_nsxv3.common.synchronization [req-9315a829-a9be-4bcf-854f-d29c8d7b6b18 req-3804300b-8ff2-4355-b0b4-5f043193c02d tempest-ServersNegativeTestJSON-1512944231 tempest-ServersNegativeTestJSON-1512944231-project-member] Enqueued Resource ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 with Priority: HIGHEST for action security_group_members [ 1030.831085] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 with Priority: HIGHEST for action security_group_members [ 1030.831607] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff50f1ab-6b6a-400e-a79f-0d29ae875687 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.831607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.831607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.831877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.831877] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.832557] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.832557] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.832557] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.832557] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.832711] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.860425] env[69920]: INFO networking_nsxv3.common.synchronization [req-b9782057-fdc4-422d-9532-0d63dac69b63 req-dc26ee5e-a4c2-46d4-a529-d968dfa31578 service nova] Enqueued Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGHEST for action security_group_rules [ 1030.860604] env[69920]: INFO networking_nsxv3.common.synchronization [req-b9782057-fdc4-422d-9532-0d63dac69b63 req-dc26ee5e-a4c2-46d4-a529-d968dfa31578 service nova] Enqueued Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGHEST for action security_group_members [ 1030.860777] env[69920]: INFO networking_nsxv3.common.synchronization [req-b9782057-fdc4-422d-9532-0d63dac69b63 req-dc26ee5e-a4c2-46d4-a529-d968dfa31578 service nova] Enqueued Resource ID: 8c5792b5-80a0-4414-bb3b-ae6e25874202 with Priority: HIGHEST for action port [ 1030.862250] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGHEST for action security_group_rules [ 1030.862511] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGHEST for action security_group_members [ 1030.866379] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5792b5-80a0-4414-bb3b-ae6e25874202 with Priority: HIGHEST for action port [ 1030.866379] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81b4d229-34c1-420c-acac-a5e9d44d33e5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.866379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.866379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.866379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.866379] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81b4d229-34c1-420c-acac-a5e9d44d33e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.866379] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-81b4d229-34c1-420c-acac-a5e9d44d33e5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.866379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.866379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.866379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.866379] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.866379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.867405] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.867440] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.867528] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.867621] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81b4d229-34c1-420c-acac-a5e9d44d33e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.868414] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c5792b5-80a0-4414-bb3b-ae6e25874202 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.868529] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c5792b5-80a0-4414-bb3b-ae6e25874202" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.868577] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c5792b5-80a0-4414-bb3b-ae6e25874202" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.868732] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c5792b5-80a0-4414-bb3b-ae6e25874202" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.868804] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c5792b5-80a0-4414-bb3b-ae6e25874202',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.874921] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.875065] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.875137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.875327] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.876036] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.876036] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 is going to be updated. [ 1030.914242] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.914683] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.914913] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.916081] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.916081] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.927020] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: IN_PROGRESS for 2s [ 1031.139878] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-272 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.140170] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-272" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.140273] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-272" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.140662] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-272" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.140961] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.141125] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.141251] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.141485] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.141652] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.141882] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1031.142016] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1031.142128] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1031.142282] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1031.142447] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1031.142589] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1031.142756] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1031.165781] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1031.165958] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1031.166118] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1031.166300] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-272" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.166629] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-eb2105ba-0276-4bc6-a2af-933090d4cdcd taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.166830] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-eb2105ba-0276-4bc6-a2af-933090d4cdcd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.167137] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-eb2105ba-0276-4bc6-a2af-933090d4cdcd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.167475] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-eb2105ba-0276-4bc6-a2af-933090d4cdcd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.167633] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb2105ba-0276-4bc6-a2af-933090d4cdcd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.335902] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.336100] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.336171] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.336465] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.336606] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.336750] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.337287] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.337287] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.337287] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.337287] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.337438] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 already deleted. [ 1031.337438] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.370419] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81b4d229-34c1-420c-acac-a5e9d44d33e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.371499] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-81b4d229-34c1-420c-acac-a5e9d44d33e5 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.372042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.372042] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c5792b5-80a0-4414-bb3b-ae6e25874202 with status ACTIVE [ 1031.372042] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.372042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.372261] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.372302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.372381] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.372587] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.372852] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.372852] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.372852] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.372997] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.373395] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.373395] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.373395] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.373395] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.373552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.373552] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c5792b5-80a0-4414-bb3b-ae6e25874202 is going to be updated. [ 1031.394915] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.395107] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.395154] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.395610] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.395610] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.395719] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c5792b5-80a0-4414-bb3b-ae6e25874202" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.672246] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.672246] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.672246] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.672246] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.672246] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.672246] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port eb2105ba-0276-4bc6-a2af-933090d4cdcd not found, creating... [ 1031.672246] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.672246] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.672246] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.672587] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.672617] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.672903] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.673079] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.673205] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.673423] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.673564] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.673710] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: eb2105ba-0276-4bc6-a2af-933090d4cdcd is going to be created. [ 1031.698048] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.702027] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.702027] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.702027] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.702027] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.702027] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-eb2105ba-0276-4bc6-a2af-933090d4cdcd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.876236] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81b4d229-34c1-420c-acac-a5e9d44d33e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.378529] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.378862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.378862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.379025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.379177] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.379260] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 is going to be created. [ 1032.412288] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.412442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.412506] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.412713] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.412878] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.423616] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 in Status: UNINITIALIZED for 2s [ 1032.663160] env[69920]: INFO networking_nsxv3.common.synchronization [req-9315a829-a9be-4bcf-854f-d29c8d7b6b18 req-3d8e73db-dba4-44f1-b578-2b008a96b466 service nova] Enqueued Resource ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 with Priority: HIGHEST for action security_group_rules [ 1032.663466] env[69920]: INFO networking_nsxv3.common.synchronization [req-9315a829-a9be-4bcf-854f-d29c8d7b6b18 req-3d8e73db-dba4-44f1-b578-2b008a96b466 service nova] Enqueued Resource ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 with Priority: HIGHEST for action security_group_members [ 1032.663639] env[69920]: INFO networking_nsxv3.common.synchronization [req-9315a829-a9be-4bcf-854f-d29c8d7b6b18 req-3d8e73db-dba4-44f1-b578-2b008a96b466 service nova] Enqueued Resource ID: eb2105ba-0276-4bc6-a2af-933090d4cdcd with Priority: HIGHEST for action port [ 1032.663869] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 with Priority: HIGHEST for action security_group_rules [ 1032.663996] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 with Priority: HIGHEST for action security_group_members [ 1032.664106] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb2105ba-0276-4bc6-a2af-933090d4cdcd with Priority: HIGHEST for action port [ 1032.664901] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff50f1ab-6b6a-400e-a79f-0d29ae875687 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.665054] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.665127] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.665390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.665488] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.666900] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff50f1ab-6b6a-400e-a79f-0d29ae875687 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.667041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.667114] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.667289] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.667445] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.669930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.669930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.669930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.669930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.669930] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.671243] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb2105ba-0276-4bc6-a2af-933090d4cdcd taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.671356] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb2105ba-0276-4bc6-a2af-933090d4cdcd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.671356] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb2105ba-0276-4bc6-a2af-933090d4cdcd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.671833] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb2105ba-0276-4bc6-a2af-933090d4cdcd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.671833] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb2105ba-0276-4bc6-a2af-933090d4cdcd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.936098] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: SUCCESS [ 1032.936313] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.936473] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.936688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.936936] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.937086] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.937150] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.937309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.937400] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.937475] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.937564] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.167636] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff50f1ab-6b6a-400e-a79f-0d29ae875687 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.167791] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.176404] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.177750] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb2105ba-0276-4bc6-a2af-933090d4cdcd with status ACTIVE [ 1033.178062] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.178260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.178335] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.179072] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.179072] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.179072] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.179072] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.179072] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.179376] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.179376] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.179513] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.179598] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.179663] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.179801] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.179894] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.180642] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb2105ba-0276-4bc6-a2af-933090d4cdcd is going to be updated. [ 1033.232019] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.232019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.232019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.232019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.232019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.232019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb2105ba-0276-4bc6-a2af-933090d4cdcd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.442769] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.442769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.442769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.442769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.442769] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.442769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.442769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.442769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.442769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.442769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.442769] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.442769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.442769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.442769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.442769] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.442769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.444099] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.444099] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.444099] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.444099] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.444099] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.687678] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.946613] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1712776d-764c-405e-85d0-105070b4c2e8: rpc.has_security_group_logging(os_id): False [ 1033.965774] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.965931] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.965973] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.966212] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.966308] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.966536] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.966641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.966705] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.966896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.966984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.967181] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.967280] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.967451] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.967495] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.967547] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.967730] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.967827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.967876] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.968699] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.968699] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.968699] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 is going to be updated. [ 1034.030320] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.030546] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.030546] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.030727] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.030870] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.047021] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: IN_PROGRESS for 2s [ 1034.193308] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.194444] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.194444] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.194444] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.194444] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.194444] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 is going to be created. [ 1034.223485] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.223485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.223485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.223485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.223485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.234569] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 in Status: UNINITIALIZED for 2s [ 1034.437077] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 in Status: SUCCESS [ 1034.437431] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.437709] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.438772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.438772] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.438772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.438772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.438772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.438772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.438772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.439156] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('81b4d229-34c1-420c-acac-a5e9d44d33e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.943758] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('81b4d229-34c1-420c-acac-a5e9d44d33e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.449436] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 81b4d229-34c1-420c-acac-a5e9d44d33e5: rpc.has_security_group_logging(os_id): False [ 1035.476441] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.476441] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.476441] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.476441] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.476441] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.476441] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.476735] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.476735] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.476812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.476812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.477007] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 is going to be created. [ 1035.543909] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.544074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.544156] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.544373] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.544573] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.560443] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 in Status: IN_PROGRESS for 2s [ 1036.062090] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: SUCCESS [ 1036.063206] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.248030] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 in Status: SUCCESS [ 1036.248319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.248605] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.249078] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.249170] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.249338] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.249803] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.249803] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.249954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.249954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.250391] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.754283] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff50f1ab-6b6a-400e-a79f-0d29ae875687 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.754389] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.754464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.754694] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.754886] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.754990] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.755052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.755214] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.755328] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.755423] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.755628] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff50f1ab-6b6a-400e-a79f-0d29ae875687 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.755737] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.755790] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.755941] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.756095] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.756190] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.756251] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.756401] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.756514] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.756929] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.756929] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.259743] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ff50f1ab-6b6a-400e-a79f-0d29ae875687: rpc.has_security_group_logging(os_id): False [ 1037.279700] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.279901] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.280055] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.280175] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.280325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.280546] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.280669] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.280803] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.280946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.281053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.281316] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.281458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.281572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.281772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.281833] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.282371] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.282371] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.282371] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.282552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.282677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.282807] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 is going to be created. [ 1037.344086] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.344218] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.344267] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.344481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.344668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.359917] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 in Status: IN_PROGRESS for 2s [ 1037.571501] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 in Status: SUCCESS [ 1037.571738] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.666377] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1037.666476] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1037.785485] env[69920]: INFO networking_nsxv3.common.synchronization [req-6ee6e714-d62e-488d-b19e-3b36f9182b00 req-1de49516-8b54-4e3b-9b6a-c276cd333a4c tempest-MigrationsAdminTest-685805879 tempest-MigrationsAdminTest-685805879-project-member] Enqueued Resource ID: 6440e2db-5336-4fd7-b450-468fa8f78560 with Priority: HIGHEST for action security_group_members [ 1037.786074] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6440e2db-5336-4fd7-b450-468fa8f78560 with Priority: HIGHEST for action security_group_members [ 1037.786527] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6440e2db-5336-4fd7-b450-468fa8f78560 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.786665] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.786748] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.786986] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.787165] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.787273] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.787330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.787483] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.787566] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.787669] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6440e2db-5336-4fd7-b450-468fa8f78560',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.292039] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.292039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.292039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.292039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.317889] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.320022] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.320022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.320022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.320022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.320022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.320022] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6440e2db-5336-4fd7-b450-468fa8f78560 is going to be updated. [ 1038.353966] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.353966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.353966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.353966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.353966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.364816] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6440e2db-5336-4fd7-b450-468fa8f78560 in Status: IN_PROGRESS for 2s [ 1039.378275] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 in Status: SUCCESS [ 1039.378275] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.674297] env[69920]: INFO networking_nsxv3.common.synchronization [None req-9ffdb09c-2571-4172-aed8-3c1432e0b5ad None None] Enqueued Resource ID: d411efa4-0cc1-4f22-9d17-490d2c0ddc16 with Priority: HIGHEST for action port [ 1039.675415] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d411efa4-0cc1-4f22-9d17-490d2c0ddc16 with Priority: HIGHEST for action port [ 1039.675809] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-d411efa4-0cc1-4f22-9d17-490d2c0ddc16 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.675947] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d411efa4-0cc1-4f22-9d17-490d2c0ddc16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.676030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d411efa4-0cc1-4f22-9d17-490d2c0ddc16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.676447] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d411efa4-0cc1-4f22-9d17-490d2c0ddc16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.676447] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d411efa4-0cc1-4f22-9d17-490d2c0ddc16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.179164] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d411efa4-0cc1-4f22-9d17-490d2c0ddc16 [ 1040.179421] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.179525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.179578] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.179795] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.179882] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.180103] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d411efa4-0cc1-4f22-9d17-490d2c0ddc16 already deleted. [ 1040.180317] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d411efa4-0cc1-4f22-9d17-490d2c0ddc16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.316020] env[69920]: INFO networking_nsxv3.common.synchronization [req-9a022410-2994-48f2-8bfe-c824da649e23 req-8b5b8961-a58f-4cec-8318-08c387bc390b tempest-ServerAddressesNegativeTestJSON-572648168 tempest-ServerAddressesNegativeTestJSON-572648168-project-member] Enqueued Resource ID: a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 with Priority: HIGHEST for action security_group_members [ 1040.316020] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 with Priority: HIGHEST for action security_group_members [ 1040.316020] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.316020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.316020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.316470] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.316470] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.316470] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.316658] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.316696] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.316754] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.316859] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.377366] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6440e2db-5336-4fd7-b450-468fa8f78560 in Status: SUCCESS [ 1040.377800] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6440e2db-5336-4fd7-b450-468fa8f78560 deletion is rescheduled due to dependency. [ 1040.378602] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.821619] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.821619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.821619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.821619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.821619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.821619] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.821619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.821619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.821974] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.821974] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.821974] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 already deleted. [ 1040.821974] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.991555] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-383 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.991715] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-383" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.991852] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-383" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.995839] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-383" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.995839] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.995961] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.996151] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.996324] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.996471] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.996682] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1040.996795] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1040.996904] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1040.997062] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1040.997842] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1040.997842] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1040.997842] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.029757] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.029972] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1041.030215] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.030497] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-383" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.030964] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-62623986-fc5c-4de6-943f-7bdd5b400e04 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.031178] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-62623986-fc5c-4de6-943f-7bdd5b400e04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.031306] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-62623986-fc5c-4de6-943f-7bdd5b400e04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.031636] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-62623986-fc5c-4de6-943f-7bdd5b400e04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.031783] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62623986-fc5c-4de6-943f-7bdd5b400e04',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.539113] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.539513] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.539513] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.539849] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.539923] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.540090] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 62623986-fc5c-4de6-943f-7bdd5b400e04 not found, creating... [ 1041.540358] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.540507] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.540711] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.540957] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.541112] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.541407] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.542606] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.542606] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.542606] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.542606] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.542606] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 62623986-fc5c-4de6-943f-7bdd5b400e04 is going to be created. [ 1041.564780] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.566870] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.566870] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.566870] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.566870] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.566870] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-62623986-fc5c-4de6-943f-7bdd5b400e04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.951655] env[69920]: INFO networking_nsxv3.common.synchronization [None req-f7acf2fc-7020-4fdd-86bd-7392f4bc1c7c None None] Enqueued Resource ID: 559497c5-a622-4f75-b647-a24fa653e41e with Priority: HIGHEST for action port [ 1041.951655] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 559497c5-a622-4f75-b647-a24fa653e41e with Priority: HIGHEST for action port [ 1041.952223] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-559497c5-a622-4f75-b647-a24fa653e41e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.952361] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-559497c5-a622-4f75-b647-a24fa653e41e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.952361] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-559497c5-a622-4f75-b647-a24fa653e41e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.952738] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-559497c5-a622-4f75-b647-a24fa653e41e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.952738] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('559497c5-a622-4f75-b647-a24fa653e41e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.455132] env[69920]: INFO networking_nsxv3.common.synchronization [None req-2f331a9a-2a0b-4170-a376-c8b682138de4 None None] Enqueued Resource ID: 53f11f03-af23-4f90-b4e8-63cd9ba1855f with Priority: HIGHEST for action port [ 1042.455132] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53f11f03-af23-4f90-b4e8-63cd9ba1855f with Priority: HIGHEST for action port [ 1042.455132] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 559497c5-a622-4f75-b647-a24fa653e41e [ 1042.459110] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.459110] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.459110] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.459110] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.459580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.461921] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:559497c5-a622-4f75-b647-a24fa653e41e already deleted. [ 1042.461921] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-559497c5-a622-4f75-b647-a24fa653e41e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.461921] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-53f11f03-af23-4f90-b4e8-63cd9ba1855f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.461921] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53f11f03-af23-4f90-b4e8-63cd9ba1855f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.461921] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53f11f03-af23-4f90-b4e8-63cd9ba1855f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.461921] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53f11f03-af23-4f90-b4e8-63cd9ba1855f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.461921] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53f11f03-af23-4f90-b4e8-63cd9ba1855f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.491279] env[69920]: INFO networking_nsxv3.common.synchronization [req-9a022410-2994-48f2-8bfe-c824da649e23 req-201ac267-83b8-4ad1-bc33-e58274e2ba9f service nova] Enqueued Resource ID: a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 with Priority: HIGHEST for action security_group_rules [ 1042.491279] env[69920]: INFO networking_nsxv3.common.synchronization [req-9a022410-2994-48f2-8bfe-c824da649e23 req-201ac267-83b8-4ad1-bc33-e58274e2ba9f service nova] Enqueued Resource ID: a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 with Priority: HIGHEST for action security_group_members [ 1042.491279] env[69920]: INFO networking_nsxv3.common.synchronization [req-9a022410-2994-48f2-8bfe-c824da649e23 req-201ac267-83b8-4ad1-bc33-e58274e2ba9f service nova] Enqueued Resource ID: 62623986-fc5c-4de6-943f-7bdd5b400e04 with Priority: HIGHEST for action port [ 1042.493688] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 with Priority: HIGHEST for action security_group_rules [ 1042.494180] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 with Priority: HIGHEST for action security_group_members [ 1042.494399] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62623986-fc5c-4de6-943f-7bdd5b400e04 with Priority: HIGHEST for action port [ 1042.495053] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.495422] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.495645] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.497115] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.497115] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.500636] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.500636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.500636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.500636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.500636] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.500636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.500636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.500636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.500636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.500636] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.501605] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-62623986-fc5c-4de6-943f-7bdd5b400e04 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.501852] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62623986-fc5c-4de6-943f-7bdd5b400e04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.501852] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62623986-fc5c-4de6-943f-7bdd5b400e04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.503139] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62623986-fc5c-4de6-943f-7bdd5b400e04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.503139] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62623986-fc5c-4de6-943f-7bdd5b400e04',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.964065] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53f11f03-af23-4f90-b4e8-63cd9ba1855f [ 1042.964379] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.965127] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.965127] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.965127] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.965127] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.965127] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53f11f03-af23-4f90-b4e8-63cd9ba1855f already deleted. [ 1042.965127] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53f11f03-af23-4f90-b4e8-63cd9ba1855f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.000492] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.000660] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.006378] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.007132] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62623986-fc5c-4de6-943f-7bdd5b400e04 with status ACTIVE [ 1043.007562] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.007562] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.007562] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.007827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.007885] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.008605] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.008605] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.008605] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.008605] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.008605] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.008605] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.009048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.009048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.009048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.009048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.012785] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62623986-fc5c-4de6-943f-7bdd5b400e04 is going to be updated. [ 1043.034393] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.034541] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.034613] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.034814] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.034955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.035140] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62623986-fc5c-4de6-943f-7bdd5b400e04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.514233] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.604481] env[69920]: INFO networking_nsxv3.common.synchronization [req-b6c3bb3c-9452-4aa3-9f4d-693ce47d7ed2 req-81828377-3c9f-4ebe-8525-4cc363f93982 tempest-AttachInterfacesTestJSON-901858583 tempest-AttachInterfacesTestJSON-901858583-project-member] Enqueued Resource ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 with Priority: HIGHEST for action security_group_members [ 1043.604481] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 with Priority: HIGHEST for action security_group_members [ 1043.604481] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e086b64-be51-49af-ac2c-6312cfa54bf4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.604481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.604481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.604726] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.605414] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.605414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.605819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.606021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.606124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.606254] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e086b64-be51-49af-ac2c-6312cfa54bf4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.008221] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.008558] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.008558] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.008785] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.009048] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.009248] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.009412] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.009647] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.009790] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.011417] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1044.011635] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1044.011765] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1044.011884] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1044.012024] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1044.012140] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1044.012282] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1044.020506] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.020700] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.020813] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.020991] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.021094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.021199] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 is going to be created. [ 1044.035785] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1044.036031] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1044.036221] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1044.036424] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.036878] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-31239db7-86bd-4d24-b54f-414bd1d5a3d1 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.037127] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-31239db7-86bd-4d24-b54f-414bd1d5a3d1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.037281] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-31239db7-86bd-4d24-b54f-414bd1d5a3d1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.037589] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-31239db7-86bd-4d24-b54f-414bd1d5a3d1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.037797] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31239db7-86bd-4d24-b54f-414bd1d5a3d1',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.050727] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.050861] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.052239] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.052239] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.052239] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.062979] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 in Status: UNINITIALIZED for 2s [ 1044.108356] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.108502] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.108572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.108772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.108864] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.109023] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.109141] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.109202] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.109329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.109392] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.109482] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 already deleted. [ 1044.109557] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.540909] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.541221] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.541420] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.541617] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.541769] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.541926] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 31239db7-86bd-4d24-b54f-414bd1d5a3d1 not found, creating... [ 1044.542239] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.542444] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.542581] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.542842] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.543040] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.543384] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.545019] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.545019] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.545019] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.548389] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.548582] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 31239db7-86bd-4d24-b54f-414bd1d5a3d1 is going to be created. [ 1044.578179] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.578179] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.578179] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.578179] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.578179] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.578179] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-31239db7-86bd-4d24-b54f-414bd1d5a3d1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.457804] env[69920]: INFO networking_nsxv3.common.synchronization [req-b6c3bb3c-9452-4aa3-9f4d-693ce47d7ed2 req-4c15b2a5-18b2-46d9-862a-a05596728370 service nova] Enqueued Resource ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 with Priority: HIGHEST for action security_group_rules [ 1045.458675] env[69920]: INFO networking_nsxv3.common.synchronization [req-b6c3bb3c-9452-4aa3-9f4d-693ce47d7ed2 req-4c15b2a5-18b2-46d9-862a-a05596728370 service nova] Enqueued Resource ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 with Priority: HIGHEST for action security_group_members [ 1045.458675] env[69920]: INFO networking_nsxv3.common.synchronization [req-b6c3bb3c-9452-4aa3-9f4d-693ce47d7ed2 req-4c15b2a5-18b2-46d9-862a-a05596728370 service nova] Enqueued Resource ID: 31239db7-86bd-4d24-b54f-414bd1d5a3d1 with Priority: HIGHEST for action port [ 1045.459558] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 with Priority: HIGHEST for action security_group_rules [ 1045.459558] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 with Priority: HIGHEST for action security_group_members [ 1045.459558] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31239db7-86bd-4d24-b54f-414bd1d5a3d1 with Priority: HIGHEST for action port [ 1045.459869] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e086b64-be51-49af-ac2c-6312cfa54bf4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.460020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.460020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.460261] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.460341] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e086b64-be51-49af-ac2c-6312cfa54bf4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.461184] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e086b64-be51-49af-ac2c-6312cfa54bf4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.461302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.461369] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.461532] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.461678] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.461766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.461827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.461976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.462087] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.462169] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e086b64-be51-49af-ac2c-6312cfa54bf4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.468068] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-31239db7-86bd-4d24-b54f-414bd1d5a3d1 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.468068] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31239db7-86bd-4d24-b54f-414bd1d5a3d1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.468068] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31239db7-86bd-4d24-b54f-414bd1d5a3d1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.468068] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31239db7-86bd-4d24-b54f-414bd1d5a3d1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.468068] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31239db7-86bd-4d24-b54f-414bd1d5a3d1',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.589145] env[69920]: INFO networking_nsxv3.common.synchronization [None req-1e859749-2549-41d5-99a9-e1bdf97626bb None None] Enqueued Resource ID: 38a8db29-8ba4-4c64-ae4c-3b3322950e9c with Priority: HIGHEST for action port [ 1045.589145] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38a8db29-8ba4-4c64-ae4c-3b3322950e9c with Priority: HIGHEST for action port [ 1045.589692] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-38a8db29-8ba4-4c64-ae4c-3b3322950e9c taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.589692] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38a8db29-8ba4-4c64-ae4c-3b3322950e9c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.589692] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38a8db29-8ba4-4c64-ae4c-3b3322950e9c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.589911] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38a8db29-8ba4-4c64-ae4c-3b3322950e9c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.589993] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38a8db29-8ba4-4c64-ae4c-3b3322950e9c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.653781] env[69920]: INFO networking_nsxv3.common.synchronization [req-08800c93-e07f-444a-8212-9b506e7758f4 req-1dcf9102-e95b-48f3-b0fe-989346874dd3 tempest-ImagesOneServerNegativeTestJSON-924528592 tempest-ImagesOneServerNegativeTestJSON-924528592-project-member] Enqueued Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_members [ 1045.654350] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_members [ 1045.654872] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.655023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.655621] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.655876] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.656150] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.656241] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.656241] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.656472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.656472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.656560] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.726504] env[69920]: INFO networking_nsxv3.common.synchronization [req-19b39e54-2583-4052-ae05-db6401bbbd58 req-49d8887a-4fa5-43dc-adbd-38b826bb86b0 tempest-ImagesTestJSON-210893687 tempest-ImagesTestJSON-210893687-project-member] Enqueued Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 1045.727149] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 1045.729117] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.729117] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.729117] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.729117] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.734501] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.734501] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.734501] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.734501] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.734501] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.734501] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.762680] env[69920]: INFO networking_nsxv3.common.synchronization [req-74309ba1-8d16-4896-9a1c-c4810973eeed req-587a8365-54a9-47e1-90cd-e0ab59406087 tempest-ServersTestFqdnHostnames-61407453 tempest-ServersTestFqdnHostnames-61407453-project-member] Enqueued Resource ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 with Priority: HIGHEST for action security_group_members [ 1045.763111] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 with Priority: HIGHEST for action security_group_members [ 1045.763430] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2ff1e5d-d0c8-419d-bc14-18543641dd30 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.763553] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.763620] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.764098] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.764098] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.768155] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.768289] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.768472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.768541] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.768577] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2ff1e5d-d0c8-419d-bc14-18543641dd30',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.968676] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e086b64-be51-49af-ac2c-6312cfa54bf4 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.970677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.970677] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e086b64-be51-49af-ac2c-6312cfa54bf4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.975399] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31239db7-86bd-4d24-b54f-414bd1d5a3d1 with status ACTIVE [ 1045.975708] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.975850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.975923] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.976195] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.976489] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.976489] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.976610] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.976644] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.976894] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.976933] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.977202] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.977326] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.977376] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.977530] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.977607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.977695] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31239db7-86bd-4d24-b54f-414bd1d5a3d1 is going to be updated. [ 1046.006481] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.006655] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.006702] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.006891] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.007091] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.007261] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31239db7-86bd-4d24-b54f-414bd1d5a3d1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.073342] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 in Status: SUCCESS [ 1046.073574] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.074111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.074316] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.074504] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.075513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.075513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.075513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.075513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.075513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.075513] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.095226] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 38a8db29-8ba4-4c64-ae4c-3b3322950e9c [ 1046.095226] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.095226] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.095226] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.095226] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.095226] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.095226] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:38a8db29-8ba4-4c64-ae4c-3b3322950e9c already deleted. [ 1046.095226] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38a8db29-8ba4-4c64-ae4c-3b3322950e9c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.159469] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.159688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.159763] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.160014] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.160097] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.160319] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.160429] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.160500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.160626] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.160696] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.160780] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb is going to be updated. [ 1046.190652] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.192543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.192543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.192543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.192543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.210320] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb in Status: IN_PROGRESS for 2s [ 1046.235296] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.253020] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-444 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.253430] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-444" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.253677] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-444" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.254114] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-444" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.254775] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.255299] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.255640] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.259885] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.260141] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.260604] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1046.261147] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1046.261538] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1046.262126] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1046.262126] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1046.262126] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1046.262126] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1046.273663] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.273663] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.273663] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.273663] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.273663] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.274654] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.274654] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.274654] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.274654] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.274654] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.274654] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 is going to be updated. [ 1046.283714] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1046.283714] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1046.283937] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1046.284396] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-444" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.285350] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-ace9865c-a7d5-41ad-abee-d70d3aa00dc0 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.285350] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-ace9865c-a7d5-41ad-abee-d70d3aa00dc0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.285350] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-ace9865c-a7d5-41ad-abee-d70d3aa00dc0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.285350] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-ace9865c-a7d5-41ad-abee-d70d3aa00dc0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.285556] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ace9865c-a7d5-41ad-abee-d70d3aa00dc0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.308862] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.308862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.308862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.308862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.308862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.317041] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 in Status: IN_PROGRESS for 2s [ 1046.476396] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e086b64-be51-49af-ac2c-6312cfa54bf4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.578485] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.578485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.578619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.578865] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.579131] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.579131] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.579131] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.579355] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.579355] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.579461] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.579515] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.579600] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.579672] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.579791] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.579926] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.580062] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.580105] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.580211] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.580284] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.580457] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.580457] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.737570] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.788799] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.789149] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.789341] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.789683] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.789892] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.790122] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port ace9865c-a7d5-41ad-abee-d70d3aa00dc0 not found, creating... [ 1046.790446] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.791324] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.791324] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.791324] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.791324] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.791477] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.791699] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.791896] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.792705] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.792910] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.794073] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: ace9865c-a7d5-41ad-abee-d70d3aa00dc0 is going to be created. [ 1046.826121] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.826121] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.826318] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.826516] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.826755] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.827606] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-ace9865c-a7d5-41ad-abee-d70d3aa00dc0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.980876] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.981113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.981167] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.981390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.981477] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.981578] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 is going to be created. [ 1047.016232] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.016386] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.016448] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.016659] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.016820] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.029555] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 in Status: UNINITIALIZED for 2s [ 1047.089236] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1: rpc.has_security_group_logging(os_id): False [ 1047.107775] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.107942] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.108055] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.108311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.108412] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.108623] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.108723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.108784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.108956] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.109025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.109243] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.109349] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.109457] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.109533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.109589] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.109775] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.110019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.110019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.110270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.110270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.110407] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 is going to be created. [ 1047.171130] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.171368] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.171368] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.171602] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.171791] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.207123] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 in Status: IN_PROGRESS for 2s [ 1047.244901] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.244901] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.244901] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.244901] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.244901] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.244901] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 is going to be updated. [ 1047.298170] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.298404] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.298476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.298657] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.298816] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.314707] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: IN_PROGRESS for 2s [ 1048.022613] env[69920]: INFO networking_nsxv3.common.synchronization [req-08800c93-e07f-444a-8212-9b506e7758f4 req-265b0f91-c067-48d5-9a52-f9a06a3ac49a service nova] Enqueued Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_rules [ 1048.022883] env[69920]: INFO networking_nsxv3.common.synchronization [req-08800c93-e07f-444a-8212-9b506e7758f4 req-265b0f91-c067-48d5-9a52-f9a06a3ac49a service nova] Enqueued Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_members [ 1048.023251] env[69920]: INFO networking_nsxv3.common.synchronization [req-08800c93-e07f-444a-8212-9b506e7758f4 req-265b0f91-c067-48d5-9a52-f9a06a3ac49a service nova] Enqueued Resource ID: ace9865c-a7d5-41ad-abee-d70d3aa00dc0 with Priority: HIGHEST for action port [ 1048.023251] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_rules [ 1048.023378] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_members [ 1048.023378] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ace9865c-a7d5-41ad-abee-d70d3aa00dc0 with Priority: HIGHEST for action port [ 1048.025477] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f8bd1f0-245d-4d6b-8841-4e7773984ffb taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.025477] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.025477] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.025477] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.025477] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.025889] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.025889] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.025987] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-ace9865c-a7d5-41ad-abee-d70d3aa00dc0 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.026123] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ace9865c-a7d5-41ad-abee-d70d3aa00dc0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.026162] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ace9865c-a7d5-41ad-abee-d70d3aa00dc0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.026307] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ace9865c-a7d5-41ad-abee-d70d3aa00dc0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.026372] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ace9865c-a7d5-41ad-abee-d70d3aa00dc0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.222725] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb in Status: SUCCESS [ 1048.222903] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb deletion is rescheduled due to dependency. [ 1048.223023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.223199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.223424] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.223603] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.223748] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.223938] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.224035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.224114] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.224212] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.333185] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 in Status: SUCCESS [ 1048.333375] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2ff1e5d-d0c8-419d-bc14-18543641dd30 deletion is rescheduled due to dependency. [ 1048.334101] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2ff1e5d-d0c8-419d-bc14-18543641dd30" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.530925] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.531077] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.534178] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ace9865c-a7d5-41ad-abee-d70d3aa00dc0 with status ACTIVE [ 1048.534178] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.534178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.534178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.534178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.534178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.534178] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.534178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.534178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.534178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.534178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.534178] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.534178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.534178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.534178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.534178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.534178] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ace9865c-a7d5-41ad-abee-d70d3aa00dc0 is going to be updated. [ 1048.554173] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.554301] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.554372] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.554576] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.554707] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.554924] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ace9865c-a7d5-41ad-abee-d70d3aa00dc0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.726860] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.039491] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 in Status: SUCCESS [ 1049.039753] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.039880] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.040110] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.040303] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.040422] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.040486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.040633] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.040712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.040792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.040880] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e086b64-be51-49af-ac2c-6312cfa54bf4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.221210] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 in Status: SUCCESS [ 1049.221435] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.227970] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.324631] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: SUCCESS [ 1049.325183] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.545662] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e086b64-be51-49af-ac2c-6312cfa54bf4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.730899] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.731208] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.731208] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.731426] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.731558] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.731674] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb is going to be updated. [ 1049.763584] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.763741] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.763812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.764136] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.764208] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.774194] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb in Status: IN_PROGRESS for 2s [ 1050.048911] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e086b64-be51-49af-ac2c-6312cfa54bf4: rpc.has_security_group_logging(os_id): False [ 1050.070427] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.070427] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.070427] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.070805] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.070805] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.070933] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.071088] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.071126] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.071343] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.071343] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.071521] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 is going to be created. [ 1050.140925] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.141126] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.141212] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.141411] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.142053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.159360] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 in Status: IN_PROGRESS for 2s [ 1050.915397] env[69920]: INFO networking_nsxv3.common.synchronization [req-d0456255-dcbd-4bdc-8093-2f39cbaa7d1c req-9b112e21-85bb-4788-bf4b-edd3da722c56 tempest-AttachVolumeNegativeTest-700673554 tempest-AttachVolumeNegativeTest-700673554-project-member] Enqueued Resource ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 with Priority: HIGHEST for action security_group_members [ 1050.917045] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 with Priority: HIGHEST for action security_group_members [ 1050.917364] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1780a9d7-a751-45c5-b020-85c8fdadacd9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.917496] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.917567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.917910] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.918130] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.918285] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.918285] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.918440] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.918523] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.918618] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1780a9d7-a751-45c5-b020-85c8fdadacd9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.983152] env[69920]: INFO networking_nsxv3.common.synchronization [req-3fe24761-cf2c-41c5-b04a-afcc2760cd23 req-191b7d02-7f0e-4dcc-a644-67f4ad2c05b9 tempest-ServersAdminNegativeTestJSON-439752242 tempest-ServersAdminNegativeTestJSON-439752242-project-member] Enqueued Resource ID: 33cfaadf-9929-4bc4-a275-43f890595f10 with Priority: HIGHEST for action security_group_members [ 1050.983152] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33cfaadf-9929-4bc4-a275-43f890595f10 with Priority: HIGHEST for action security_group_members [ 1050.983152] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-33cfaadf-9929-4bc4-a275-43f890595f10 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.983152] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.983152] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.983937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.984305] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.984590] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.984763] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.985173] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.987999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.987999] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33cfaadf-9929-4bc4-a275-43f890595f10',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.421117] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.421524] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.421524] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.421674] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.422083] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.422402] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.422547] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.422613] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.422812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.422920] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.422985] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 is going to be updated. [ 1051.455680] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.455843] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.455967] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.456315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.456529] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.481559] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 in Status: IN_PROGRESS for 2s [ 1051.489397] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.489620] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.489782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.489950] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.490070] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.490320] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.490491] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.490587] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.490692] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.490775] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.490851] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33cfaadf-9929-4bc4-a275-43f890595f10 is going to be updated. [ 1051.540437] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.540687] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.540803] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.544022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.544022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.551570] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33cfaadf-9929-4bc4-a275-43f890595f10 in Status: IN_PROGRESS for 2s [ 1051.786685] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb in Status: SUCCESS [ 1051.786993] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.787310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.787636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.788216] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.788216] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.788216] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.788793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.788793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.788793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.788970] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.173487] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 in Status: SUCCESS [ 1052.173723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.292216] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.292556] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.292624] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.292862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.293047] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.293148] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.294508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.294508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.294508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.294508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.294508] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.294508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.294508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.294508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.294508] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.294508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.294508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.294508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.295015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.295015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.295015] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.798267] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8f8bd1f0-245d-4d6b-8841-4e7773984ffb: rpc.has_security_group_logging(os_id): False [ 1052.822028] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.822028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.822213] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.822342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.822396] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.823295] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.823295] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.823295] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.823295] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.823295] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.823295] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.823295] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.823685] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.823685] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.823685] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.823788] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.823852] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.823909] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.824084] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.824731] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.824731] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb is going to be updated. [ 1052.897959] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.897959] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.897959] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.898304] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.898304] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.934195] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb in Status: IN_PROGRESS for 2s [ 1053.495643] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 in Status: SUCCESS [ 1053.496125] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 deletion is rescheduled due to dependency. [ 1053.496125] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.564935] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33cfaadf-9929-4bc4-a275-43f890595f10 in Status: SUCCESS [ 1053.565601] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33cfaadf-9929-4bc4-a275-43f890595f10 deletion is rescheduled due to dependency. [ 1053.565601] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.817027] env[69920]: INFO networking_nsxv3.common.synchronization [req-524a524d-df64-487e-b0e1-df35051a6496 req-24f849e5-83e9-4f11-9091-566f2e0f4bd8 tempest-ServersAdminTestJSON-859816448 tempest-ServersAdminTestJSON-859816448-project-member] Enqueued Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 1053.817027] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 1053.817027] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.817027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.817027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.817027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.817910] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.818193] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.818370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.818664] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.818888] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.820192] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.323342] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.824501] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.951901] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb in Status: SUCCESS [ 1054.953452] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.328029] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.328250] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.328334] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.328599] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.328709] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.328855] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a is going to be updated. [ 1055.361085] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.361412] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.361488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.361746] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.361960] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.377119] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: IN_PROGRESS for 2s [ 1055.974156] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-436 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.974492] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-436" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.974756] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-436" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.975183] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-436" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.975812] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.976219] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.976571] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.977064] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.977287] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.977486] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1055.978199] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1055.978199] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1055.978199] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1055.978199] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1055.978199] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1055.978521] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1056.000954] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1056.001177] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1056.001382] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1056.002598] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-436" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.002598] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-699de5cd-28f8-453d-8f0a-7856f2d6a2b0 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.002598] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-699de5cd-28f8-453d-8f0a-7856f2d6a2b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.002598] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-699de5cd-28f8-453d-8f0a-7856f2d6a2b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.002598] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-699de5cd-28f8-453d-8f0a-7856f2d6a2b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.002853] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('699de5cd-28f8-453d-8f0a-7856f2d6a2b0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.016944] env[69920]: INFO networking_nsxv3.common.synchronization [req-b8438293-e822-422c-bdd3-b7c6868c299c req-63aa60aa-037b-4c66-aeff-3dc1fd370398 tempest-ServerAddressesNegativeTestJSON-572648168 tempest-ServerAddressesNegativeTestJSON-572648168-project-member] Enqueued Resource ID: a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 with Priority: HIGHEST for action security_group_members [ 1056.017309] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 with Priority: HIGHEST for action security_group_members [ 1056.017642] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.017766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.017833] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.018329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.018329] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.018498] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.018498] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.018623] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.018840] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.018941] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.507703] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.507703] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.507703] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.507703] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.507703] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.507703] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.507703] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.507703] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.507703] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.508177] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.508503] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.508614] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.508779] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.508981] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.511834] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.511834] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 699de5cd-28f8-453d-8f0a-7856f2d6a2b0 is going to be updated. [ 1056.523417] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.523682] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.523682] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.524500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.524500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.524500] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.524500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.524500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.524500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.524500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.524828] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 is going to be updated. [ 1056.534795] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.535138] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.535297] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.535581] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.535783] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.536280] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-699de5cd-28f8-453d-8f0a-7856f2d6a2b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.557023] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.557023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.557023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.557023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.557023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.568930] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 in Status: IN_PROGRESS for 2s [ 1057.322828] env[69920]: INFO networking_nsxv3.common.synchronization [req-a71eb5aa-b3e9-4899-b603-04c8ad9ee65d req-9d577c1a-ce45-42e9-bd68-918488d7b019 service nova] Enqueued Resource ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf with Priority: HIGHEST for action security_group_rules [ 1057.323103] env[69920]: INFO networking_nsxv3.common.synchronization [req-a71eb5aa-b3e9-4899-b603-04c8ad9ee65d req-9d577c1a-ce45-42e9-bd68-918488d7b019 service nova] Enqueued Resource ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf with Priority: HIGHEST for action security_group_members [ 1057.323290] env[69920]: INFO networking_nsxv3.common.synchronization [req-a71eb5aa-b3e9-4899-b603-04c8ad9ee65d req-9d577c1a-ce45-42e9-bd68-918488d7b019 service nova] Enqueued Resource ID: 699de5cd-28f8-453d-8f0a-7856f2d6a2b0 with Priority: HIGHEST for action port [ 1057.323969] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf with Priority: HIGHEST for action security_group_rules [ 1057.324359] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf with Priority: HIGHEST for action security_group_members [ 1057.324527] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 699de5cd-28f8-453d-8f0a-7856f2d6a2b0 with Priority: HIGHEST for action port [ 1057.324870] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.325078] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.327636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.327636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.327636] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.327636] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.327636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.328593] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.328846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.330616] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.330779] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.330852] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.331078] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.331175] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.331271] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.332169] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-699de5cd-28f8-453d-8f0a-7856f2d6a2b0 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.332321] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-699de5cd-28f8-453d-8f0a-7856f2d6a2b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.332418] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-699de5cd-28f8-453d-8f0a-7856f2d6a2b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.332600] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-699de5cd-28f8-453d-8f0a-7856f2d6a2b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.332680] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('699de5cd-28f8-453d-8f0a-7856f2d6a2b0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.388572] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: SUCCESS [ 1057.388794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.828535] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.828731] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.834293] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.835240] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 699de5cd-28f8-453d-8f0a-7856f2d6a2b0 with status ACTIVE [ 1057.835439] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.835566] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.835632] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.835844] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.835934] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.836121] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.836215] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.836277] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.836431] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.836593] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.836810] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.836915] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.836970] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.837165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.837253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.837346] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 699de5cd-28f8-453d-8f0a-7856f2d6a2b0 is going to be updated. [ 1057.862693] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.862854] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.862921] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.863165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.863310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.863476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-699de5cd-28f8-453d-8f0a-7856f2d6a2b0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.338933] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.585151] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 in Status: SUCCESS [ 1058.585413] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 deletion is rescheduled due to dependency. [ 1058.585413] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.686854] env[69920]: INFO networking_nsxv3.common.synchronization [None req-28057fc1-c542-46fd-ba08-c22626176194 None None] Enqueued Resource ID: 9a94b7ab-681f-4e49-af85-8ff8829f17c7 with Priority: HIGHEST for action port [ 1058.688617] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a94b7ab-681f-4e49-af85-8ff8829f17c7 with Priority: HIGHEST for action port [ 1058.689208] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a94b7ab-681f-4e49-af85-8ff8829f17c7 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.689280] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a94b7ab-681f-4e49-af85-8ff8829f17c7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.689680] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a94b7ab-681f-4e49-af85-8ff8829f17c7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.689790] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a94b7ab-681f-4e49-af85-8ff8829f17c7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.689857] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a94b7ab-681f-4e49-af85-8ff8829f17c7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.747083] env[69920]: INFO networking_nsxv3.common.synchronization [req-5b023dce-96c4-4f40-aa75-020d170cc63d req-0a93fb41-534f-4981-9959-163b6802a917 tempest-ServerMetadataNegativeTestJSON-1540832771 tempest-ServerMetadataNegativeTestJSON-1540832771-project-member] Enqueued Resource ID: 215a1eaa-c047-4dab-aaf3-49d2cea752dc with Priority: HIGHEST for action security_group_members [ 1058.747939] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 215a1eaa-c047-4dab-aaf3-49d2cea752dc with Priority: HIGHEST for action security_group_members [ 1058.748676] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-215a1eaa-c047-4dab-aaf3-49d2cea752dc taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.748676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.748676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.748676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.748965] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.748965] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.749063] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.749190] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.749253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.749320] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('215a1eaa-c047-4dab-aaf3-49d2cea752dc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.843625] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.843930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.844016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.844226] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.844441] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.844671] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf is going to be updated. [ 1058.881459] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.881751] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.883024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.883024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.883024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.896099] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf in Status: IN_PROGRESS for 2s [ 1059.112771] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-866 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.113037] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-866" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.113170] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-866" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.113496] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-866" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.113810] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.114046] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.114195] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.114463] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.114582] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.114793] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1059.114912] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1059.115031] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1059.115188] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1059.115311] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1059.115475] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1059.115737] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1059.144758] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1059.144758] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1059.144758] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1059.144758] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-866" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.144758] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-28547515-b928-4d6f-8849-dd2430f73245 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.144758] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-28547515-b928-4d6f-8849-dd2430f73245" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.144758] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-28547515-b928-4d6f-8849-dd2430f73245" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.144758] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-28547515-b928-4d6f-8849-dd2430f73245" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.144758] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28547515-b928-4d6f-8849-dd2430f73245',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.194454] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a94b7ab-681f-4e49-af85-8ff8829f17c7 [ 1059.194989] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.195155] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.196046] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.196046] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.196046] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.196046] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a94b7ab-681f-4e49-af85-8ff8829f17c7 already deleted. [ 1059.196046] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a94b7ab-681f-4e49-af85-8ff8829f17c7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.251936] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.252182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.252252] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.252617] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.252617] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.252716] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.252845] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.252893] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.253038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.253120] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.253210] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 215a1eaa-c047-4dab-aaf3-49d2cea752dc already deleted. [ 1059.253294] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.649751] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.650069] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.650147] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.650444] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.650602] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.650766] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 28547515-b928-4d6f-8849-dd2430f73245 not found, creating... [ 1059.651049] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.651268] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.651365] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.651575] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.651719] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.652014] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.652185] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.652312] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.652528] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.652667] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.652812] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 28547515-b928-4d6f-8849-dd2430f73245 is going to be created. [ 1059.680629] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.680629] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.680629] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.680629] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.680629] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.680629] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-28547515-b928-4d6f-8849-dd2430f73245" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.406684] env[69920]: INFO networking_nsxv3.common.synchronization [req-c20152ea-0c63-4573-87f0-c6bdb9416a66 req-656a12fe-446e-4f5e-8c18-e6493fb1b8ed tempest-ImagesOneServerNegativeTestJSON-924528592 tempest-ImagesOneServerNegativeTestJSON-924528592-project-member] Enqueued Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_members [ 1060.407418] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGHEST for action security_group_members [ 1060.408573] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.409399] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.409514] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.409772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.409968] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.411164] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.411274] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.411484] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.411689] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.411759] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.510886] env[69920]: INFO networking_nsxv3.common.synchronization [req-5b023dce-96c4-4f40-aa75-020d170cc63d req-ecab4d82-c433-4437-b668-f35fae2c59a5 service nova] Enqueued Resource ID: 215a1eaa-c047-4dab-aaf3-49d2cea752dc with Priority: HIGHEST for action security_group_rules [ 1060.511390] env[69920]: INFO networking_nsxv3.common.synchronization [req-5b023dce-96c4-4f40-aa75-020d170cc63d req-ecab4d82-c433-4437-b668-f35fae2c59a5 service nova] Enqueued Resource ID: 215a1eaa-c047-4dab-aaf3-49d2cea752dc with Priority: HIGHEST for action security_group_members [ 1060.511390] env[69920]: INFO networking_nsxv3.common.synchronization [req-5b023dce-96c4-4f40-aa75-020d170cc63d req-ecab4d82-c433-4437-b668-f35fae2c59a5 service nova] Enqueued Resource ID: 28547515-b928-4d6f-8849-dd2430f73245 with Priority: HIGHEST for action port [ 1060.511864] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 215a1eaa-c047-4dab-aaf3-49d2cea752dc with Priority: HIGHEST for action security_group_rules [ 1060.511986] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 215a1eaa-c047-4dab-aaf3-49d2cea752dc with Priority: HIGHEST for action security_group_members [ 1060.511986] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28547515-b928-4d6f-8849-dd2430f73245 with Priority: HIGHEST for action port [ 1060.512421] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-215a1eaa-c047-4dab-aaf3-49d2cea752dc taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.512568] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.512637] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.512946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.513472] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('215a1eaa-c047-4dab-aaf3-49d2cea752dc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.514121] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-215a1eaa-c047-4dab-aaf3-49d2cea752dc taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.514121] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.514258] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.514340] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.514530] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.514659] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.514748] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.514937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.515052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.515175] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('215a1eaa-c047-4dab-aaf3-49d2cea752dc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.516144] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-28547515-b928-4d6f-8849-dd2430f73245 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.516418] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28547515-b928-4d6f-8849-dd2430f73245" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.516418] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28547515-b928-4d6f-8849-dd2430f73245" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.516639] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28547515-b928-4d6f-8849-dd2430f73245" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.516745] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28547515-b928-4d6f-8849-dd2430f73245',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.907196] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf in Status: SUCCESS [ 1060.907517] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.907622] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.909294] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.909294] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.909294] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.909294] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.909294] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.909294] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.909294] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.909294] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.917019] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.917019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.917019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.917019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.917019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.917019] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.917019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.917019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.917019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.917019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.917019] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb is going to be updated. [ 1060.950394] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.950394] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.950394] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.950394] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.950394] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.957524] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb in Status: IN_PROGRESS for 2s [ 1061.018700] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-215a1eaa-c047-4dab-aaf3-49d2cea752dc taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.018880] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.019090] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('215a1eaa-c047-4dab-aaf3-49d2cea752dc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.020099] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 28547515-b928-4d6f-8849-dd2430f73245 with status ACTIVE [ 1061.021026] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.021026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.021026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.021026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.021026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.021026] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.021477] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.021477] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.021477] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.021477] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.021757] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.021757] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.021875] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.022260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.022260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.022260] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 28547515-b928-4d6f-8849-dd2430f73245 is going to be updated. [ 1061.048817] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.049204] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.049320] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.049536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.049673] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.049867] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28547515-b928-4d6f-8849-dd2430f73245" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.351846] env[69920]: INFO networking_nsxv3.common.synchronization [None req-5c7eae0d-4660-444f-98b3-53ae9f66bba1 None None] Enqueued Resource ID: 938aa405-4ac5-4dca-aaf0-d882754dec27 with Priority: HIGHEST for action port [ 1061.352158] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938aa405-4ac5-4dca-aaf0-d882754dec27 with Priority: HIGHEST for action port [ 1061.352566] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-938aa405-4ac5-4dca-aaf0-d882754dec27 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.352675] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-938aa405-4ac5-4dca-aaf0-d882754dec27" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.352720] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-938aa405-4ac5-4dca-aaf0-d882754dec27" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.352973] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-938aa405-4ac5-4dca-aaf0-d882754dec27" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.353069] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('938aa405-4ac5-4dca-aaf0-d882754dec27',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.413145] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.524239] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('215a1eaa-c047-4dab-aaf3-49d2cea752dc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.856421] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 938aa405-4ac5-4dca-aaf0-d882754dec27 [ 1061.856421] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.856421] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.856421] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.856421] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.856421] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.856421] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:938aa405-4ac5-4dca-aaf0-d882754dec27 already deleted. [ 1061.856984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-938aa405-4ac5-4dca-aaf0-d882754dec27" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.915742] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf: rpc.has_security_group_logging(os_id): False [ 1061.938473] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.938838] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.938838] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.939056] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.962061] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.963035] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.963035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.963035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.963035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.963035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.963035] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf is going to be updated. [ 1062.028275] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.028491] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.028572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.029842] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.029842] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.029842] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 215a1eaa-c047-4dab-aaf3-49d2cea752dc is going to be created. [ 1062.036169] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.036302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.036351] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.036550] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.036688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.056823] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf in Status: IN_PROGRESS for 2s [ 1062.067024] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.067315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.067385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.067657] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.067891] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.084483] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 215a1eaa-c047-4dab-aaf3-49d2cea752dc in Status: UNINITIALIZED for 2s [ 1062.196126] env[69920]: INFO networking_nsxv3.common.synchronization [req-2c42dd5f-8725-4acb-b963-b422b0f092c4 req-42601386-7332-46ef-b8ed-fe4b3769a6d8 tempest-DeleteServersTestJSON-1690074738 tempest-DeleteServersTestJSON-1690074738-project-member] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 1062.196769] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 1062.197935] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.197935] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.197935] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.197935] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.198244] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.198244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.198244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.198433] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.198469] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.198580] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.703804] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.703804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.703804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.703804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.703804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.703804] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.703804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.703804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.703804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.703804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.703804] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be updated. [ 1062.736436] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.736436] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.736706] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.736939] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.737200] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.748854] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: IN_PROGRESS for 2s [ 1062.969784] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb in Status: SUCCESS [ 1062.969784] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb deletion is rescheduled due to dependency. [ 1062.969784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.770617] env[69920]: INFO networking_nsxv3.common.synchronization [None req-1ee7260b-df48-4f89-b8bc-dd568e3faba4 tempest-ServerDiskConfigTestJSON-714416826 tempest-ServerDiskConfigTestJSON-714416826-project-member] Enqueued Resource ID: f81960d1-e921-476d-ab28-b2bae9059fc9 with Priority: HIGHEST for action security_group_rules [ 1063.771930] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81960d1-e921-476d-ab28-b2bae9059fc9 with Priority: HIGHEST for action security_group_rules [ 1063.772473] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f81960d1-e921-476d-ab28-b2bae9059fc9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.772641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f81960d1-e921-476d-ab28-b2bae9059fc9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.772713] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f81960d1-e921-476d-ab28-b2bae9059fc9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.772943] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f81960d1-e921-476d-ab28-b2bae9059fc9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.773045] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f81960d1-e921-476d-ab28-b2bae9059fc9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.902053] env[69920]: INFO networking_nsxv3.common.synchronization [None req-e678983d-67a0-498e-a3b4-8e3a3c958dbd tempest-ServerDiskConfigTestJSON-714416826 tempest-ServerDiskConfigTestJSON-714416826-project-member] Enqueued Resource ID: f81960d1-e921-476d-ab28-b2bae9059fc9 with Priority: HIGHEST for action security_group_rules [ 1063.902806] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81960d1-e921-476d-ab28-b2bae9059fc9 with Priority: HIGHEST for action security_group_rules [ 1063.903184] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f81960d1-e921-476d-ab28-b2bae9059fc9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.903562] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f81960d1-e921-476d-ab28-b2bae9059fc9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.074465] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf in Status: SUCCESS [ 1064.074778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.097173] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 215a1eaa-c047-4dab-aaf3-49d2cea752dc in Status: SUCCESS [ 1064.097478] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.097648] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.097910] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.098142] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.098267] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.098331] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.098489] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.098604] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.098682] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.098797] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('215a1eaa-c047-4dab-aaf3-49d2cea752dc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.301465] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.301623] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.302032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.302032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.302032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.302181] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f81960d1-e921-476d-ab28-b2bae9059fc9 already deleted. [ 1064.302219] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f81960d1-e921-476d-ab28-b2bae9059fc9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.302378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f81960d1-e921-476d-ab28-b2bae9059fc9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.302552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f81960d1-e921-476d-ab28-b2bae9059fc9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.302635] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f81960d1-e921-476d-ab28-b2bae9059fc9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.601667] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-215a1eaa-c047-4dab-aaf3-49d2cea752dc taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.601815] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.601948] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.602310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.602601] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.603179] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.603260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.603449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.603543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.603638] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.603801] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-215a1eaa-c047-4dab-aaf3-49d2cea752dc taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.603901] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.603963] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.604130] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.604279] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.604372] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.604446] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.604572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.604642] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.604726] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.604819] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('215a1eaa-c047-4dab-aaf3-49d2cea752dc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.760035] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: SUCCESS [ 1064.760254] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a deletion is rescheduled due to dependency. [ 1064.760331] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.827353] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.827714] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.827714] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.827806] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.827872] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.827957] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f81960d1-e921-476d-ab28-b2bae9059fc9 already deleted. [ 1064.828051] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f81960d1-e921-476d-ab28-b2bae9059fc9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.107553] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 215a1eaa-c047-4dab-aaf3-49d2cea752dc: rpc.has_security_group_logging(os_id): False [ 1065.131642] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.131642] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.131642] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.131642] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.131642] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.131642] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.131642] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.131642] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.131642] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.131642] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.131642] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.132199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.132199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.132199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.132199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.132199] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.132397] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.132397] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.132471] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.132510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.133018] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 215a1eaa-c047-4dab-aaf3-49d2cea752dc is going to be created. [ 1065.300816] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.300816] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.300816] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.301040] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.301127] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.317996] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 215a1eaa-c047-4dab-aaf3-49d2cea752dc in Status: IN_PROGRESS for 2s [ 1067.339989] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 215a1eaa-c047-4dab-aaf3-49d2cea752dc in Status: SUCCESS [ 1067.339989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.194128] env[69920]: INFO networking_nsxv3.common.synchronization [req-84e19dcd-9d6b-49da-9308-ecfe474dce16 req-50996159-2870-4ce4-9e35-d99c959425e4 tempest-ServerDiskConfigTestJSON-714416826 tempest-ServerDiskConfigTestJSON-714416826-project-member] Enqueued Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 1068.194792] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 1068.195525] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.195525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.195525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.195525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.195744] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.195799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.195846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.195988] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.199416] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.199604] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.209945] env[69920]: INFO networking_nsxv3.common.synchronization [req-3356c948-924a-4d1c-b2c2-99facbb29a47 req-0f95a692-3310-4d25-89e3-d3ffbef32e92 tempest-InstanceActionsV221TestJSON-1577346487 tempest-InstanceActionsV221TestJSON-1577346487-project-member] Enqueued Resource ID: b24a2070-f252-45c0-aead-3c64371a04f8 with Priority: HIGHEST for action security_group_members [ 1068.209945] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b24a2070-f252-45c0-aead-3c64371a04f8 with Priority: HIGHEST for action security_group_members [ 1068.209945] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-b24a2070-f252-45c0-aead-3c64371a04f8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.209945] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.209945] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.209945] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.211071] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.211071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.211071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.211071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.211071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.211071] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b24a2070-f252-45c0-aead-3c64371a04f8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.712026] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.712026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.712026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.712026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.712026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.712026] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.712026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.712026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.712026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.712026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.712026] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 is going to be updated. [ 1068.713781] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.714038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.714038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.714234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.714334] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.715054] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.716270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.716270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.716270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.716270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.716270] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b24a2070-f252-45c0-aead-3c64371a04f8 already deleted. [ 1068.716270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.719717] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-794 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.719962] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-794" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.720830] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-794" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.720830] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-794" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.721133] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.721448] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.721580] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.721933] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.722176] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.722484] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1068.722655] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1068.722823] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1068.723362] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1068.723362] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1068.723508] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1068.724583] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1068.750228] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1068.751304] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1068.751304] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1068.751650] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-794" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.752368] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-65e8d7bd-d544-4d00-974f-b16cf425a4dc taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.752748] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-65e8d7bd-d544-4d00-974f-b16cf425a4dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.752801] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-65e8d7bd-d544-4d00-974f-b16cf425a4dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.753163] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-65e8d7bd-d544-4d00-974f-b16cf425a4dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.753416] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65e8d7bd-d544-4d00-974f-b16cf425a4dc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.757569] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.757569] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.757569] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.757569] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.757569] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.771193] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: IN_PROGRESS for 2s [ 1069.260527] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.260792] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.260995] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.261380] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.261536] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.261769] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 65e8d7bd-d544-4d00-974f-b16cf425a4dc not found, creating... [ 1069.262146] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.262374] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.262562] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.262889] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.263096] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.263521] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.263735] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.263855] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.264142] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.264323] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.264463] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 65e8d7bd-d544-4d00-974f-b16cf425a4dc is going to be created. [ 1069.289761] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.289983] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.290207] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.290855] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.291343] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.291619] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-65e8d7bd-d544-4d00-974f-b16cf425a4dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.153781] env[69920]: INFO networking_nsxv3.common.synchronization [req-3356c948-924a-4d1c-b2c2-99facbb29a47 req-b8b047cf-4c62-4dbf-a85f-bb2438738ead service nova] Enqueued Resource ID: b24a2070-f252-45c0-aead-3c64371a04f8 with Priority: HIGHEST for action security_group_rules [ 1070.154167] env[69920]: INFO networking_nsxv3.common.synchronization [req-3356c948-924a-4d1c-b2c2-99facbb29a47 req-b8b047cf-4c62-4dbf-a85f-bb2438738ead service nova] Enqueued Resource ID: b24a2070-f252-45c0-aead-3c64371a04f8 with Priority: HIGHEST for action security_group_members [ 1070.154167] env[69920]: INFO networking_nsxv3.common.synchronization [req-3356c948-924a-4d1c-b2c2-99facbb29a47 req-b8b047cf-4c62-4dbf-a85f-bb2438738ead service nova] Enqueued Resource ID: 65e8d7bd-d544-4d00-974f-b16cf425a4dc with Priority: HIGHEST for action port [ 1070.154330] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b24a2070-f252-45c0-aead-3c64371a04f8 with Priority: HIGHEST for action security_group_rules [ 1070.154461] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b24a2070-f252-45c0-aead-3c64371a04f8 with Priority: HIGHEST for action security_group_members [ 1070.154560] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65e8d7bd-d544-4d00-974f-b16cf425a4dc with Priority: HIGHEST for action port [ 1070.156019] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b24a2070-f252-45c0-aead-3c64371a04f8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.156274] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.156274] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.156509] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.156603] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b24a2070-f252-45c0-aead-3c64371a04f8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.159542] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-b24a2070-f252-45c0-aead-3c64371a04f8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.159758] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.159758] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.159954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.160128] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.160251] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.160311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.160468] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.160891] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.160891] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b24a2070-f252-45c0-aead-3c64371a04f8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.161870] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-65e8d7bd-d544-4d00-974f-b16cf425a4dc taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.162017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65e8d7bd-d544-4d00-974f-b16cf425a4dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.163081] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65e8d7bd-d544-4d00-974f-b16cf425a4dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.163081] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65e8d7bd-d544-4d00-974f-b16cf425a4dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.163081] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65e8d7bd-d544-4d00-974f-b16cf425a4dc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.660421] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-b24a2070-f252-45c0-aead-3c64371a04f8 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.660568] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.668707] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b24a2070-f252-45c0-aead-3c64371a04f8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.669762] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65e8d7bd-d544-4d00-974f-b16cf425a4dc with status ACTIVE [ 1070.669971] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.670109] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.670178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.670391] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.670485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.670660] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.670761] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.670825] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.670975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.671066] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.671243] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.671337] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.671401] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.671541] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.671616] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.671700] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65e8d7bd-d544-4d00-974f-b16cf425a4dc is going to be updated. [ 1070.693719] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.694847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.694847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.694847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.694847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.695068] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65e8d7bd-d544-4d00-974f-b16cf425a4dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.781110] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: SUCCESS [ 1070.781467] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 deletion is rescheduled due to dependency. [ 1070.781891] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.877253] env[69920]: INFO networking_nsxv3.common.synchronization [None req-759a317d-7807-4653-8d46-c68a3aab2119 None None] Enqueued Resource ID: 3134d52b-1cd3-413c-aeb5-29b1e2469674 with Priority: HIGHEST for action port [ 1070.877889] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3134d52b-1cd3-413c-aeb5-29b1e2469674 with Priority: HIGHEST for action port [ 1070.878285] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-3134d52b-1cd3-413c-aeb5-29b1e2469674 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.878472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3134d52b-1cd3-413c-aeb5-29b1e2469674" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.878609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3134d52b-1cd3-413c-aeb5-29b1e2469674" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.878875] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3134d52b-1cd3-413c-aeb5-29b1e2469674" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.879015] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3134d52b-1cd3-413c-aeb5-29b1e2469674',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.176384] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b24a2070-f252-45c0-aead-3c64371a04f8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.381023] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3134d52b-1cd3-413c-aeb5-29b1e2469674 [ 1071.381379] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.381607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.381716] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.382015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.382716] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.382716] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3134d52b-1cd3-413c-aeb5-29b1e2469674 already deleted. [ 1071.382716] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3134d52b-1cd3-413c-aeb5-29b1e2469674" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.678599] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.678759] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.678827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.679720] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.679720] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.679720] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b24a2070-f252-45c0-aead-3c64371a04f8 is going to be created. [ 1071.681308] env[69920]: INFO networking_nsxv3.common.synchronization [req-aa796942-b0d9-4a65-b7df-e930c928efbc req-14678721-e6d9-4c43-814d-d13dcd1c7a98 tempest-ServersTestJSON-738065696 tempest-ServersTestJSON-738065696-project-member] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1071.681906] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1071.682773] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.682896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.683051] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.683246] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.684391] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.684391] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.684391] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.684391] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.684391] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.684391] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.709064] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.709263] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.709369] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.710292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.710292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.723964] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b24a2070-f252-45c0-aead-3c64371a04f8 in Status: UNINITIALIZED for 2s [ 1072.054877] env[69920]: INFO networking_nsxv3.common.synchronization [None req-8f5a5232-69a1-480f-af4a-3ea9ee647284 tempest-ServerActionsV293TestJSON-1763504731 tempest-ServerActionsV293TestJSON-1763504731-project-member] Enqueued Resource ID: bc15688a-089f-4071-9a2b-93e87f28f846 with Priority: HIGHEST for action security_group_rules [ 1072.055946] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc15688a-089f-4071-9a2b-93e87f28f846 with Priority: HIGHEST for action security_group_rules [ 1072.056921] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc15688a-089f-4071-9a2b-93e87f28f846 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.057259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.057427] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.057817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.057992] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc15688a-089f-4071-9a2b-93e87f28f846',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.166118] env[69920]: INFO networking_nsxv3.common.synchronization [None req-d9b5ccef-dc79-45b6-b0f8-2b698b06cdac tempest-ServerActionsV293TestJSON-1763504731 tempest-ServerActionsV293TestJSON-1763504731-project-member] Enqueued Resource ID: bc15688a-089f-4071-9a2b-93e87f28f846 with Priority: HIGHEST for action security_group_rules [ 1072.166118] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc15688a-089f-4071-9a2b-93e87f28f846 with Priority: HIGHEST for action security_group_rules [ 1072.166118] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc15688a-089f-4071-9a2b-93e87f28f846 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.166118] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.185625] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.185950] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.185950] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.186356] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.186462] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.186666] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.186760] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.186833] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.187055] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.187142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.187236] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 already deleted. [ 1072.187374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.563624] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-21 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.563624] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.563947] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.564573] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.565063] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.565428] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.565705] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.566091] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.567122] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.567122] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1072.567122] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1072.567122] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1072.567122] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1072.567122] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1072.567613] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1072.567613] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1072.589862] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1072.589862] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1072.589862] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1072.589862] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.589862] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-885a1391-dd28-4b0c-ae60-7ae0c571a32a taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.589862] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-885a1391-dd28-4b0c-ae60-7ae0c571a32a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.589862] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-885a1391-dd28-4b0c-ae60-7ae0c571a32a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.591466] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-885a1391-dd28-4b0c-ae60-7ae0c571a32a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.591466] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('885a1391-dd28-4b0c-ae60-7ae0c571a32a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.593724] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.593861] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.594813] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.594855] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.594966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.595177] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc15688a-089f-4071-9a2b-93e87f28f846 already deleted. [ 1072.595319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.595719] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.595934] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.596104] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc15688a-089f-4071-9a2b-93e87f28f846',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.097757] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.098791] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.098791] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.098791] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.098984] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.099138] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 885a1391-dd28-4b0c-ae60-7ae0c571a32a not found, creating... [ 1073.100313] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.100313] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.100313] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.102038] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.102038] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.102038] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.102038] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.102038] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.102312] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.102501] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.102731] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 885a1391-dd28-4b0c-ae60-7ae0c571a32a is going to be created. [ 1073.122783] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.123430] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.123430] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.123430] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.123905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.123905] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc15688a-089f-4071-9a2b-93e87f28f846 already deleted. [ 1073.123905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.124880] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.125112] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.125252] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.125546] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.125801] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.127268] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-885a1391-dd28-4b0c-ae60-7ae0c571a32a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.689402] env[69920]: INFO networking_nsxv3.common.synchronization [None req-4505c93c-b855-4cfa-9011-3cead5b073db None None] Enqueued Resource ID: 464cdde7-20ec-4608-978a-c9cc8b41bfe9 with Priority: HIGHEST for action port [ 1073.690199] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 464cdde7-20ec-4608-978a-c9cc8b41bfe9 with Priority: HIGHEST for action port [ 1073.690557] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-464cdde7-20ec-4608-978a-c9cc8b41bfe9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.690687] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-464cdde7-20ec-4608-978a-c9cc8b41bfe9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.690794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-464cdde7-20ec-4608-978a-c9cc8b41bfe9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.691067] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-464cdde7-20ec-4608-978a-c9cc8b41bfe9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.691197] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('464cdde7-20ec-4608-978a-c9cc8b41bfe9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.724713] env[69920]: INFO networking_nsxv3.common.synchronization [req-10dab88e-538a-4d02-ad2a-0d874944f04c req-6ba27c31-e1de-4489-be42-0d733fbc8df4 tempest-ServerMetadataNegativeTestJSON-1540832771 tempest-ServerMetadataNegativeTestJSON-1540832771-project-member] Enqueued Resource ID: 215a1eaa-c047-4dab-aaf3-49d2cea752dc with Priority: HIGHEST for action security_group_members [ 1073.726507] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 215a1eaa-c047-4dab-aaf3-49d2cea752dc with Priority: HIGHEST for action security_group_members [ 1073.727195] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-215a1eaa-c047-4dab-aaf3-49d2cea752dc taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.727195] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.727195] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.727495] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.727539] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.727769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.727769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.727878] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.727936] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.728015] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('215a1eaa-c047-4dab-aaf3-49d2cea752dc',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.743394] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b24a2070-f252-45c0-aead-3c64371a04f8 in Status: SUCCESS [ 1073.743394] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.743394] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.743822] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.744161] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.745016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.745016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.745016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.745016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.745016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.745016] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b24a2070-f252-45c0-aead-3c64371a04f8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.944080] env[69920]: INFO networking_nsxv3.common.synchronization [req-aa796942-b0d9-4a65-b7df-e930c928efbc req-3b4d2638-eddc-432c-9490-5a67a7dcd767 service nova] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_rules [ 1073.944602] env[69920]: INFO networking_nsxv3.common.synchronization [req-aa796942-b0d9-4a65-b7df-e930c928efbc req-3b4d2638-eddc-432c-9490-5a67a7dcd767 service nova] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1073.944790] env[69920]: INFO networking_nsxv3.common.synchronization [req-aa796942-b0d9-4a65-b7df-e930c928efbc req-3b4d2638-eddc-432c-9490-5a67a7dcd767 service nova] Enqueued Resource ID: 885a1391-dd28-4b0c-ae60-7ae0c571a32a with Priority: HIGHEST for action port [ 1073.946521] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_rules [ 1073.946684] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1073.946745] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 885a1391-dd28-4b0c-ae60-7ae0c571a32a with Priority: HIGHEST for action port [ 1073.949234] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.949234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.949234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.949564] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.949657] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.950882] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.951032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.951090] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.951282] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.951469] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.951580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.951697] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.951786] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.951874] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.951970] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.954167] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-885a1391-dd28-4b0c-ae60-7ae0c571a32a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.954167] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-885a1391-dd28-4b0c-ae60-7ae0c571a32a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.954167] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-885a1391-dd28-4b0c-ae60-7ae0c571a32a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.954167] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-885a1391-dd28-4b0c-ae60-7ae0c571a32a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.954167] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('885a1391-dd28-4b0c-ae60-7ae0c571a32a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.193696] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 464cdde7-20ec-4608-978a-c9cc8b41bfe9 [ 1074.193923] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.194059] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.194124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.194327] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.194410] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.194501] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:464cdde7-20ec-4608-978a-c9cc8b41bfe9 already deleted. [ 1074.194576] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-464cdde7-20ec-4608-978a-c9cc8b41bfe9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.231073] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.231337] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.231453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.232479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.232479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.232479] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.232479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.232479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.232479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.232479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.232479] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 215a1eaa-c047-4dab-aaf3-49d2cea752dc is going to be updated. [ 1074.249354] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-b24a2070-f252-45c0-aead-3c64371a04f8 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.249354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.249354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.249354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.253908] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.253908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.253908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.253908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.253908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.253908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.253908] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-b24a2070-f252-45c0-aead-3c64371a04f8 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.253908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.253908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.253908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.253908] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.253908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.253908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.253908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.253908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.253908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.253908] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b24a2070-f252-45c0-aead-3c64371a04f8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.265409] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.265826] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.265904] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.266130] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.266318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.281484] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 215a1eaa-c047-4dab-aaf3-49d2cea752dc in Status: IN_PROGRESS for 2s [ 1074.454291] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.455527] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 885a1391-dd28-4b0c-ae60-7ae0c571a32a with status ACTIVE [ 1074.455729] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.455865] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.455907] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.456140] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.456227] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.456459] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.456591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.456655] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.456835] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.456924] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.457150] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.457245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.457347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.457487] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.457587] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.457713] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 885a1391-dd28-4b0c-ae60-7ae0c571a32a is going to be updated. [ 1074.459211] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.459349] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.482811] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.483062] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.483062] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.483263] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.483408] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.484710] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-885a1391-dd28-4b0c-ae60-7ae0c571a32a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.755568] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b24a2070-f252-45c0-aead-3c64371a04f8: rpc.has_security_group_logging(os_id): False [ 1074.778277] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.780999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.780999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.780999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.780999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.780999] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.780999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.780999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.780999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.780999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.780999] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.780999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.780999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.780999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.780999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.781740] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.781740] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.781740] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.781740] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.781740] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.781740] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b24a2070-f252-45c0-aead-3c64371a04f8 is going to be created. [ 1074.849952] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.850243] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.850243] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.850486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.850687] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.863125] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b24a2070-f252-45c0-aead-3c64371a04f8 in Status: IN_PROGRESS for 2s [ 1074.961631] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.463563] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.463934] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.463934] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.464231] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.464347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.464458] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be created. [ 1075.490152] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.490152] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.490152] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.490409] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.490449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.504202] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: UNINITIALIZED for 2s [ 1075.740454] env[69920]: INFO networking_nsxv3.common.synchronization [req-2cef688f-5e4e-45f7-aa96-d39c85e94278 req-b28abaac-bfbc-4968-b323-c9e12002d490 tempest-ImagesTestJSON-210893687 tempest-ImagesTestJSON-210893687-project-member] Enqueued Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 1075.745168] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 1075.746486] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.746668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.746747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.747050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.747208] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.747374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.747436] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.747607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.747795] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.747905] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.254133] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.254676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.254676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.254676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.254676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.255376] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.255376] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.255376] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.255601] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.255601] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.255673] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 is going to be updated. [ 1076.289314] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.289500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.289598] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.289916] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.290047] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.292699] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 215a1eaa-c047-4dab-aaf3-49d2cea752dc in Status: SUCCESS [ 1076.293272] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 215a1eaa-c047-4dab-aaf3-49d2cea752dc deletion is rescheduled due to dependency. [ 1076.293272] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-215a1eaa-c047-4dab-aaf3-49d2cea752dc" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.299816] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: IN_PROGRESS for 2s [ 1076.887096] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b24a2070-f252-45c0-aead-3c64371a04f8 in Status: SUCCESS [ 1076.887783] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.513441] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1077.513772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.513889] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.514201] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.514414] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.514617] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.514617] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.514822] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.514919] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.515026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.515144] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.021514] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.021514] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.021514] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.021722] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.025019] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.025019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.025019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.025019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.025019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.025019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.025019] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.025019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.025019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.025019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.025019] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.025019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.025019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.025019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.025019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.025019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.025019] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.102137] env[69920]: INFO networking_nsxv3.common.synchronization [req-ea4d760d-b3b0-4acd-9fc0-dfb6e0b65600 req-7ea8a366-5287-478d-b395-a2b60c361b8b tempest-ServersNegativeTestJSON-1512944231 tempest-ServersNegativeTestJSON-1512944231-project-member] Enqueued Resource ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 with Priority: HIGHEST for action security_group_members [ 1078.106843] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 with Priority: HIGHEST for action security_group_members [ 1078.107470] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff50f1ab-6b6a-400e-a79f-0d29ae875687 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.107585] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.107656] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.107871] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.108035] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.108156] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.108263] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.108500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.108612] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.108720] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.312366] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: SUCCESS [ 1078.312556] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 deletion is rescheduled due to dependency. [ 1078.312695] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.525897] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd313130-fb41-4c30-96a8-0facc1385d33: rpc.has_security_group_logging(os_id): False [ 1078.548370] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.548599] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.548800] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.549128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.549128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.549128] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.549283] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.549283] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.549420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.549488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.549670] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.549763] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.549822] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.549963] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.550047] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.550242] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.550330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.550391] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.550533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.550605] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.550787] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be created. [ 1078.611254] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.615669] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.615669] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.615669] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.615669] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.615669] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.627943] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1078.679962] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-272 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.680998] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-272" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.680998] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-272" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.681171] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-272" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.681477] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.681674] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.681799] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.682058] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.682214] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.682430] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1078.682548] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1078.682745] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1078.682812] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1078.682892] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1078.683035] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1078.683184] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1078.710505] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1078.710922] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1078.710922] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1078.711146] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-272" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.711417] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-c7cb00d8-8939-41db-b3dd-8dd937a6daf1 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.711616] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-c7cb00d8-8939-41db-b3dd-8dd937a6daf1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.711759] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-c7cb00d8-8939-41db-b3dd-8dd937a6daf1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.712170] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-c7cb00d8-8939-41db-b3dd-8dd937a6daf1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.712322] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7cb00d8-8939-41db-b3dd-8dd937a6daf1',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.117760] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.217675] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.218150] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.218338] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.218712] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.218935] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.219164] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port c7cb00d8-8939-41db-b3dd-8dd937a6daf1 not found, creating... [ 1079.219509] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.219786] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.220025] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.220344] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.220551] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.221191] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.221191] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.221363] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.221941] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.222348] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.222588] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: c7cb00d8-8939-41db-b3dd-8dd937a6daf1 is going to be created. [ 1079.246527] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.246866] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.246953] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.247256] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.247667] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.247939] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-c7cb00d8-8939-41db-b3dd-8dd937a6daf1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.621144] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.621416] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.621416] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.621611] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.622363] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.622363] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 is going to be updated. [ 1079.650225] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.651168] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.651168] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.651168] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.651168] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.661412] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 in Status: IN_PROGRESS for 2s [ 1079.927580] env[69920]: INFO networking_nsxv3.common.synchronization [req-ea4d760d-b3b0-4acd-9fc0-dfb6e0b65600 req-02873252-3675-47f7-b115-af6b2f619560 service nova] Enqueued Resource ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 with Priority: HIGHEST for action security_group_rules [ 1079.927735] env[69920]: INFO networking_nsxv3.common.synchronization [req-ea4d760d-b3b0-4acd-9fc0-dfb6e0b65600 req-02873252-3675-47f7-b115-af6b2f619560 service nova] Enqueued Resource ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 with Priority: HIGHEST for action security_group_members [ 1079.927893] env[69920]: INFO networking_nsxv3.common.synchronization [req-ea4d760d-b3b0-4acd-9fc0-dfb6e0b65600 req-02873252-3675-47f7-b115-af6b2f619560 service nova] Enqueued Resource ID: c7cb00d8-8939-41db-b3dd-8dd937a6daf1 with Priority: HIGHEST for action port [ 1079.928167] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 with Priority: HIGHEST for action security_group_rules [ 1079.928331] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 with Priority: HIGHEST for action security_group_members [ 1079.928650] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7cb00d8-8939-41db-b3dd-8dd937a6daf1 with Priority: HIGHEST for action port [ 1079.930527] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff50f1ab-6b6a-400e-a79f-0d29ae875687 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.930758] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.930835] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.931055] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.931136] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.932252] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff50f1ab-6b6a-400e-a79f-0d29ae875687 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.932412] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.933050] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7cb00d8-8939-41db-b3dd-8dd937a6daf1 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.933050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7cb00d8-8939-41db-b3dd-8dd937a6daf1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.933050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7cb00d8-8939-41db-b3dd-8dd937a6daf1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.934160] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7cb00d8-8939-41db-b3dd-8dd937a6daf1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.934160] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7cb00d8-8939-41db-b3dd-8dd937a6daf1',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.437668] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff50f1ab-6b6a-400e-a79f-0d29ae875687 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.437668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.437668] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c7cb00d8-8939-41db-b3dd-8dd937a6daf1 with status ACTIVE [ 1080.437668] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.438015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.438015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.438092] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.438209] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.438321] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.438670] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.438670] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.439485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.439485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.439625] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.439689] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.440465] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.440465] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.440465] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.440465] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c7cb00d8-8939-41db-b3dd-8dd937a6daf1 is going to be updated. [ 1080.465021] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.465204] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.465336] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.465595] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.465652] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.466081] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7cb00d8-8939-41db-b3dd-8dd937a6daf1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.641366] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1080.641831] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.177308] env[69920]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1081.177842] env[69920]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] NSXv3 Agent Agent loop - iteration:2 started [ 1081.672302] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 in Status: SUCCESS [ 1081.672686] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.672763] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.672999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.673228] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.673388] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.673455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.673643] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.673729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.673828] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.176306] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.679642] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.848989] env[69920]: INFO networking_nsxv3.common.synchronization [req-88ba8a65-bc86-4e44-81be-187b22606691 req-6cacde12-ff29-49f4-b7c5-614964d91733 tempest-InstanceActionsV221TestJSON-1577346487 tempest-InstanceActionsV221TestJSON-1577346487-project-member] Enqueued Resource ID: b24a2070-f252-45c0-aead-3c64371a04f8 with Priority: HIGHEST for action security_group_members [ 1082.849568] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b24a2070-f252-45c0-aead-3c64371a04f8 with Priority: HIGHEST for action security_group_members [ 1082.851043] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-b24a2070-f252-45c0-aead-3c64371a04f8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.851431] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.851570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.851856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.852094] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.852281] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.852383] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.852613] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.852753] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.852891] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b24a2070-f252-45c0-aead-3c64371a04f8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.185589] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.185831] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.185831] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.186593] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.186593] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.186593] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 is going to be updated. [ 1083.222106] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.222294] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.222370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.222956] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.222956] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.233629] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 in Status: IN_PROGRESS for 2s [ 1083.355483] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.355765] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.355765] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.355953] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.356070] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.356312] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.356474] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.356546] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.356682] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.356763] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.356839] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b24a2070-f252-45c0-aead-3c64371a04f8 is going to be updated. [ 1083.391073] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.391073] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.391073] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.391073] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.391073] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.400640] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b24a2070-f252-45c0-aead-3c64371a04f8 in Status: IN_PROGRESS for 2s [ 1083.819939] env[69920]: INFO networking_nsxv3.common.synchronization [req-959a9101-4951-4a60-8265-57f5e7d83cf5 req-5bbfb816-d3d5-4536-87e7-e654598a91e9 tempest-ServersWithSpecificFlavorTestJSON-1780415271 tempest-ServersWithSpecificFlavorTestJSON-1780415271-project-member] Enqueued Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGHEST for action security_group_members [ 1083.821509] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGHEST for action security_group_members [ 1083.821846] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-81b4d229-34c1-420c-acac-a5e9d44d33e5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.822236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.822236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.822333] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.822902] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.823034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.823403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.823403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.823403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.823522] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81b4d229-34c1-420c-acac-a5e9d44d33e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.326118] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.326358] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.326358] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.326625] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.326753] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.326993] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.327144] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.327229] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.327363] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.327481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.327591] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 is going to be updated. [ 1084.358361] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.358919] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.359046] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.359310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.359498] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.369212] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 in Status: IN_PROGRESS for 2s [ 1085.245676] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 in Status: SUCCESS [ 1085.246139] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.246217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.246448] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.246714] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.246884] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.246971] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.247210] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.247310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.247456] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.247592] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.414067] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b24a2070-f252-45c0-aead-3c64371a04f8 in Status: SUCCESS [ 1085.414286] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b24a2070-f252-45c0-aead-3c64371a04f8 deletion is rescheduled due to dependency. [ 1085.414478] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.751434] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff50f1ab-6b6a-400e-a79f-0d29ae875687 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.751434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.751434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.751434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.751688] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.751688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.751688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.751891] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.751958] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.752043] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.752192] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff50f1ab-6b6a-400e-a79f-0d29ae875687 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.752269] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.752343] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.752479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.752644] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.752763] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.752833] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.752985] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.753078] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.753164] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.753256] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.256416] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ff50f1ab-6b6a-400e-a79f-0d29ae875687: rpc.has_security_group_logging(os_id): False [ 1086.277297] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.277297] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.277297] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.277297] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.277297] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.277297] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.277297] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.277297] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.277297] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.277297] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.277297] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.277297] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.278378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.280320] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.280320] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.280320] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.280320] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.280320] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.280320] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.280320] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.280320] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 is going to be updated. [ 1086.348234] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.348234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.348510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.348553] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.348733] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.362058] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 in Status: IN_PROGRESS for 2s [ 1086.379482] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 in Status: SUCCESS [ 1086.379630] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 deletion is rescheduled due to dependency. [ 1086.379630] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.124305] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.124305] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.124305] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.124305] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.124305] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.544714] env[69920]: INFO networking_nsxv3.common.synchronization [req-d3ede1c2-5cb6-42f0-a44f-a17e786fe6b6 req-da42bc45-8679-4614-bac4-6477feb60722 tempest-ServersAdminTestJSON-859816448 tempest-ServersAdminTestJSON-859816448-project-member] Enqueued Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 1087.545248] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 1087.545591] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.545740] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.545808] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.545972] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.546130] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.546231] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.546283] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.546432] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.546515] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.546632] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.633964] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.049167] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.138938] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.379345] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 in Status: SUCCESS [ 1088.379345] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.552984] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.646656] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1088.646656] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1088.733070] env[69920]: INFO networking_nsxv3.common.synchronization [req-a8ad89bb-194c-4a9e-af89-3c6c937ef357 req-efa90c4c-ece0-47da-979b-8d925acaa0e2 tempest-ServerTagsTestJSON-1641259867 tempest-ServerTagsTestJSON-1641259867-project-member] Enqueued Resource ID: c3844e5d-1857-4823-ae42-ffaed25f95f9 with Priority: HIGHEST for action security_group_members [ 1088.734093] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3844e5d-1857-4823-ae42-ffaed25f95f9 with Priority: HIGHEST for action security_group_members [ 1088.735133] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3844e5d-1857-4823-ae42-ffaed25f95f9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.735133] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.735133] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.735592] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.735818] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.735987] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.736121] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.736370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.736510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.736663] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3844e5d-1857-4823-ae42-ffaed25f95f9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.058218] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.058218] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.058218] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.058218] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.058218] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.058218] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a is going to be updated. [ 1089.094091] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.094284] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.094348] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.095097] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.095097] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.109030] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: IN_PROGRESS for 2s [ 1089.151095] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.151095] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-467" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.151095] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-467" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.151604] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-467" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.151604] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.155028] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.155028] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.155028] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.155028] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.155028] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1089.155028] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1089.155028] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1089.155028] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1089.155028] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1089.155028] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1089.155028] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1089.184962] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1089.185169] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1089.186545] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1089.186545] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-467" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.186545] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-a1e7adcd-1321-49ab-a876-14b8e90db77c taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.186545] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-a1e7adcd-1321-49ab-a876-14b8e90db77c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.186907] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-a1e7adcd-1321-49ab-a876-14b8e90db77c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.187179] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-a1e7adcd-1321-49ab-a876-14b8e90db77c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.187409] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1e7adcd-1321-49ab-a876-14b8e90db77c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.239267] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.239406] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.239445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.239741] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.239839] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.240790] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.240790] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.240790] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.240790] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.240790] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.240790] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3844e5d-1857-4823-ae42-ffaed25f95f9 already deleted. [ 1089.240790] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.624428] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.624428] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.624924] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.624924] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.639201] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1089.640296] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.641982] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1089.678801] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.678801] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.678801] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.678801] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.688802] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.689526] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1089.689600] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1089.689698] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1089.691023] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.691220] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.691347] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.691644] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.693590] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.693590] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port a1e7adcd-1321-49ab-a876-14b8e90db77c not found, creating... [ 1089.693590] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.693590] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.693590] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.693590] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.693590] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.693590] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.693590] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.693590] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.694372] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.694372] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.694372] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: a1e7adcd-1321-49ab-a876-14b8e90db77c is going to be created. [ 1089.717336] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.717619] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.717923] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.718066] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.718304] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.718564] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-a1e7adcd-1321-49ab-a876-14b8e90db77c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.744552] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.744552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.744552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.744552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.746035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.746257] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1089.890836] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.891764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.891764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.891764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.891764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.892033] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1090.000680] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.000990] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.000990] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.001187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.001362] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.001651] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:45. [ 1090.001756] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'0e59b5ff-c965-44e5-b635-07a76f775de9', 'b6124cb4-db5b-4093-b85f-7d68bc614215', '81b4d229-34c1-420c-acac-a5e9d44d33e5', '4d847f61-da82-4a79-82ae-c393059854e9', 'c19f5e9b-e818-4af4-9417-0ddc1f2e116c', '225fb705-337d-4abe-9a25-de3a33d5a961', '7e086b64-be51-49af-ac2c-6312cfa54bf4', '7fdaff9b-63be-497c-8622-3160e739856a', '1780a9d7-a751-45c5-b020-85c8fdadacd9', '6cbc5f86-4dd3-4809-8201-0103be329ab2', '3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f', '702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf', '82051f94-9eeb-470d-aa42-9e827049069f', 'a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1', '0e86ba42-7c29-4732-915b-33713b63d0b7', '33cfaadf-9929-4bc4-a275-43f890595f10', '0ae58702-5520-4afd-abbd-064c34515d9b', 'b24a2070-f252-45c0-aead-3c64371a04f8', '7eba410e-a0d6-4873-9363-054f457d21d4', '32db8592-539e-44ed-a2b9-910bd1e0f62f', '7aae69a5-1701-43e9-9978-86df7a832270', 'b1a5abeb-ac32-4d23-a23f-c0ae308abad8', '40f3bd9f-8637-49e8-92cd-03812c846cfd', 'a9141c37-2b91-4c20-add2-e8a0090bfc23', 'fb749722-17ca-41f8-9be5-6aa59fad95b3', 'a7b62144-a34e-4e44-9dda-a1306bb3fa05', '48d70a54-3f5c-40ef-9cc4-f5d82c01a717', '8f8bd1f0-245d-4d6b-8841-4e7773984ffb', 'e31e2ae5-2f08-403b-b19a-697a36f3cb16', 'd76d1ef7-21d9-442e-8d89-3b9cfee5a4ac', 'ff50f1ab-6b6a-400e-a79f-0d29ae875687', '6440e2db-5336-4fd7-b450-468fa8f78560', '361f5d4b-d775-40f2-9486-50f4511d4852', 'dd313130-fb41-4c30-96a8-0facc1385d33', 'b3cdaff7-e960-4617-83ae-85aa804dab73', '154896d4-d0bc-49e9-8d89-5fcc04260b1a', '287306e2-c53f-4a5f-82ab-b97a6d8f9e37', 'd2ff1e5d-d0c8-419d-bc14-18543641dd30', '5a8bd4df-a8df-4d64-94ea-a00a62c48a01', '1712776d-764c-405e-85d0-105070b4c2e8', 'a6054485-180a-4f29-a65a-3151187db51e', '394b8a58-53d4-4ddb-998c-b2810a22cd53', '215a1eaa-c047-4dab-aaf3-49d2cea752dc', '0a9f1a73-f43f-451c-8ce2-328d0b73b769', '156af133-c5cb-4af5-87be-b21d4422308a'} {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1090.001898] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1090.033225] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.033516] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.033516] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.033653] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.033730] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.033867] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1090.033945] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1090.034033] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1090.125451] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.125605] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.125696] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.125896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.126895] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.127170] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1090.127348] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1090.127461] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1090.127543] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1090.127667] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/45 resources of Type:Security Group Rules [ 1090.127757] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0e59b5ff-c965-44e5-b635-07a76f775de9 with Priority: HIGH for action security_group_rules [ 1090.127757] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b6124cb4-db5b-4093-b85f-7d68bc614215 with Priority: HIGH for action security_group_rules [ 1090.128275] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGH for action security_group_rules [ 1090.128275] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4d847f61-da82-4a79-82ae-c393059854e9 with Priority: HIGH for action security_group_rules [ 1090.128275] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c with Priority: HIGH for action security_group_rules [ 1090.128275] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 225fb705-337d-4abe-9a25-de3a33d5a961 with Priority: HIGH for action security_group_rules [ 1090.128275] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 with Priority: HIGH for action security_group_rules [ 1090.128275] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGH for action security_group_rules [ 1090.128275] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 with Priority: HIGH for action security_group_rules [ 1090.128275] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 with Priority: HIGH for action security_group_rules [ 1090.128275] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f with Priority: HIGH for action security_group_rules [ 1090.128776] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf with Priority: HIGH for action security_group_rules [ 1090.128776] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 82051f94-9eeb-470d-aa42-9e827049069f with Priority: HIGH for action security_group_rules [ 1090.128776] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 with Priority: HIGH for action security_group_rules [ 1090.128776] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 with Priority: HIGH for action security_group_rules [ 1090.128776] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 33cfaadf-9929-4bc4-a275-43f890595f10 with Priority: HIGH for action security_group_rules [ 1090.128776] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGH for action security_group_rules [ 1090.128776] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b24a2070-f252-45c0-aead-3c64371a04f8 with Priority: HIGH for action security_group_rules [ 1090.128776] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGH for action security_group_rules [ 1090.129334] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f with Priority: HIGH for action security_group_rules [ 1090.129334] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.167193] env[69920]: INFO networking_nsxv3.common.synchronization [req-10281646-013b-4fb1-8616-d8bc61fe71d1 req-1a10dbc9-987f-406a-bb0c-ef08e2191104 tempest-AttachVolumeNegativeTest-700673554 tempest-AttachVolumeNegativeTest-700673554-project-member] Enqueued Resource ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 with Priority: HIGHEST for action security_group_members [ 1090.168050] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 with Priority: HIGHEST for action security_group_members [ 1090.168050] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e59b5ff-c965-44e5-b635-07a76f775de9 with Priority: HIGH for action security_group_rules [ 1090.168050] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGH for action security_group_rules [ 1090.168258] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 with Priority: HIGH for action security_group_rules [ 1090.168258] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 with Priority: HIGH for action security_group_rules [ 1090.168354] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f with Priority: HIGH for action security_group_rules [ 1090.168419] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGH for action security_group_rules [ 1090.169074] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b24a2070-f252-45c0-aead-3c64371a04f8 with Priority: HIGH for action security_group_rules [ 1090.169074] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGH for action security_group_rules [ 1090.169074] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 with Priority: HIGH for action security_group_rules [ 1090.169074] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33cfaadf-9929-4bc4-a275-43f890595f10 with Priority: HIGH for action security_group_rules [ 1090.169074] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82051f94-9eeb-470d-aa42-9e827049069f with Priority: HIGH for action security_group_rules [ 1090.169074] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf with Priority: HIGH for action security_group_rules [ 1090.169074] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f with Priority: HIGH for action security_group_rules [ 1090.169074] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 with Priority: HIGH for action security_group_rules [ 1090.169425] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 with Priority: HIGH for action security_group_rules [ 1090.169425] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 225fb705-337d-4abe-9a25-de3a33d5a961 with Priority: HIGH for action security_group_rules [ 1090.169425] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGH for action security_group_rules [ 1090.169425] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c with Priority: HIGH for action security_group_rules [ 1090.169555] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6124cb4-db5b-4093-b85f-7d68bc614215 with Priority: HIGH for action security_group_rules [ 1090.169555] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d847f61-da82-4a79-82ae-c393059854e9 with Priority: HIGH for action security_group_rules [ 1090.169974] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-394b8a58-53d4-4ddb-998c-b2810a22cd53 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.170126] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.170190] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.170499] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.170573] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.171829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.171925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.172193] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.172288] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.172387] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('394b8a58-53d4-4ddb-998c-b2810a22cd53',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.173403] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e59b5ff-c965-44e5-b635-07a76f775de9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.173537] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.173592] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.173939] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.173939] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e59b5ff-c965-44e5-b635-07a76f775de9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.179022] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81b4d229-34c1-420c-acac-a5e9d44d33e5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.179022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.179022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.179022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.179022] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81b4d229-34c1-420c-acac-a5e9d44d33e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.179022] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e086b64-be51-49af-ac2c-6312cfa54bf4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.179022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.179022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.179022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.179022] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e086b64-be51-49af-ac2c-6312cfa54bf4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.179795] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e86ba42-7c29-4732-915b-33713b63d0b7 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.179795] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.179795] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.179795] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.179795] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e86ba42-7c29-4732-915b-33713b63d0b7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.180499] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32db8592-539e-44ed-a2b9-910bd1e0f62f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.180600] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.180676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.180832] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.180907] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32db8592-539e-44ed-a2b9-910bd1e0f62f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.181761] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.181918] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.184106] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.184106] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.184106] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.184106] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b24a2070-f252-45c0-aead-3c64371a04f8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.184106] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.184106] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.184106] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.184106] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b24a2070-f252-45c0-aead-3c64371a04f8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.184106] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.184738] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.184738] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.184738] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.184738] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.185577] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.185577] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.185577] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.185577] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.185577] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.187819] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33cfaadf-9929-4bc4-a275-43f890595f10 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.187819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.187819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.187819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.187819] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33cfaadf-9929-4bc4-a275-43f890595f10',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.187819] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82051f94-9eeb-470d-aa42-9e827049069f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.187819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.187819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.187819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.187819] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82051f94-9eeb-470d-aa42-9e827049069f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.189145] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.189145] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.189145] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.189145] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.189145] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.189513] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.189652] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.189705] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.189832] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.189916] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.195371] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cbc5f86-4dd3-4809-8201-0103be329ab2 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.195371] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.195371] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.195797] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.195797] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cbc5f86-4dd3-4809-8201-0103be329ab2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.196601] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1780a9d7-a751-45c5-b020-85c8fdadacd9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.196726] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.196800] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.196953] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.197035] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1780a9d7-a751-45c5-b020-85c8fdadacd9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.197825] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-225fb705-337d-4abe-9a25-de3a33d5a961 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.197947] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.198031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.198209] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.198278] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('225fb705-337d-4abe-9a25-de3a33d5a961',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.203072] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.203253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.203322] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.203556] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.203618] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.204673] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c19f5e9b-e818-4af4-9417-0ddc1f2e116c taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.204839] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.204902] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.205057] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.205137] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c19f5e9b-e818-4af4-9417-0ddc1f2e116c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.205986] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6124cb4-db5b-4093-b85f-7d68bc614215 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.206921] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.207033] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.207309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.207427] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6124cb4-db5b-4093-b85f-7d68bc614215',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.209079] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d847f61-da82-4a79-82ae-c393059854e9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.209348] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.209348] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.209503] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.209558] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d847f61-da82-4a79-82ae-c393059854e9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.548868] env[69920]: INFO networking_nsxv3.common.synchronization [req-a8ad89bb-194c-4a9e-af89-3c6c937ef357 req-18aaecf9-6c37-4ad3-8902-2adc16aaaa3f service nova] Enqueued Resource ID: c3844e5d-1857-4823-ae42-ffaed25f95f9 with Priority: HIGHEST for action security_group_rules [ 1090.549088] env[69920]: INFO networking_nsxv3.common.synchronization [req-a8ad89bb-194c-4a9e-af89-3c6c937ef357 req-18aaecf9-6c37-4ad3-8902-2adc16aaaa3f service nova] Enqueued Resource ID: c3844e5d-1857-4823-ae42-ffaed25f95f9 with Priority: HIGHEST for action security_group_members [ 1090.549231] env[69920]: INFO networking_nsxv3.common.synchronization [req-a8ad89bb-194c-4a9e-af89-3c6c937ef357 req-18aaecf9-6c37-4ad3-8902-2adc16aaaa3f service nova] Enqueued Resource ID: a1e7adcd-1321-49ab-a876-14b8e90db77c with Priority: HIGHEST for action port [ 1090.549743] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3844e5d-1857-4823-ae42-ffaed25f95f9 with Priority: HIGHEST for action security_group_rules [ 1090.549879] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3844e5d-1857-4823-ae42-ffaed25f95f9 with Priority: HIGHEST for action security_group_members [ 1090.549968] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1e7adcd-1321-49ab-a876-14b8e90db77c with Priority: HIGHEST for action port [ 1090.550445] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3844e5d-1857-4823-ae42-ffaed25f95f9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.550614] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.550663] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.550912] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.551008] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3844e5d-1857-4823-ae42-ffaed25f95f9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.553330] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3844e5d-1857-4823-ae42-ffaed25f95f9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.553330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.553330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.553330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.553330] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.553330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.553330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.553330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.553330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.554339] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3844e5d-1857-4823-ae42-ffaed25f95f9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.558587] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1e7adcd-1321-49ab-a876-14b8e90db77c taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.558702] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1e7adcd-1321-49ab-a876-14b8e90db77c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.558757] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1e7adcd-1321-49ab-a876-14b8e90db77c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.558925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1e7adcd-1321-49ab-a876-14b8e90db77c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.559010] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1e7adcd-1321-49ab-a876-14b8e90db77c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.716825] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e086b64-be51-49af-ac2c-6312cfa54bf4 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.716825] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.716825] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.716825] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.716825] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.716825] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.716825] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.716825] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.716825] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.716825] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.716825] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e086b64-be51-49af-ac2c-6312cfa54bf4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.719279] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.719764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.719764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.719764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.719764] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.719960] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.719960] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.720044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.720114] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.720234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.720286] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.730054] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-225fb705-337d-4abe-9a25-de3a33d5a961 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.730311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.730466] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.730944] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.731246] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.731246] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.731246] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.731498] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.732761] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.732761] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.732761] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('225fb705-337d-4abe-9a25-de3a33d5a961',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.734366] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.734495] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.734566] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.734735] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.743625] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.744073] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.744265] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.744532] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.744757] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.744933] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.745050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.745276] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.745454] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.745647] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.745804] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.756427] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.770268] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.797852] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.798072] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.802096] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.802220] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.828280] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.828400] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.829786] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.829906] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.831334] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.831334] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.833215] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.833325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.834280] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.834421] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.835425] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.835425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.836072] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.836176] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.837793] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.837793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.838061] env[69920]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1090.838427] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.839035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.839895] env[69920]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1090.839895] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.839895] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.840685] env[69920]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1090.841118] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.841212] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.841832] env[69920]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1090.842280] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.842378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.843012] env[69920]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1090.843450] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.843615] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.844707] env[69920]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1090.844707] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.844964] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.844964] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.845066] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.845227] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.845311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.845406] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 is going to be updated. [ 1090.846643] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.846834] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.848418] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.848516] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.867693] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.868149] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cbc5f86-4dd3-4809-8201-0103be329ab2 is going to be deleted. [ 1090.869043] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.869280] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.887707] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.887707] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.887707] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.888045] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.888197] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.894218] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.894392] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32db8592-539e-44ed-a2b9-910bd1e0f62f is going to be deleted. [ 1090.895596] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.896165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.898721] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 in Status: IN_PROGRESS for 2s [ 1090.935403] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.935403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.940035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.940035] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 is going to be deleted. [ 1090.940035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.940035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.975369] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.975369] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.976762] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.976762] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33cfaadf-9929-4bc4-a275-43f890595f10 is going to be deleted. [ 1090.977363] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.978306] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.012249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.012249] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f is going to be deleted. [ 1091.013594] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.013594] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.053275] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3844e5d-1857-4823-ae42-ffaed25f95f9 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.053411] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.059671] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3844e5d-1857-4823-ae42-ffaed25f95f9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.062028] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1e7adcd-1321-49ab-a876-14b8e90db77c with status ACTIVE [ 1091.062028] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.062148] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.062148] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.062327] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.062414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.062596] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.062699] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.062761] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.062917] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.062992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.063186] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.063278] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.063341] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.063505] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.063559] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.063638] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1e7adcd-1321-49ab-a876-14b8e90db77c is going to be updated. [ 1091.066544] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.067111] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d847f61-da82-4a79-82ae-c393059854e9 is going to be deleted. [ 1091.067780] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.068019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.116722] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.116944] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.129520] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: SUCCESS [ 1091.129735] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.131072] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.132824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.132824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.132824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.132824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.132824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1e7adcd-1321-49ab-a876-14b8e90db77c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.141674] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.141907] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.150391] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.150391] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.174587] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.174735] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6124cb4-db5b-4093-b85f-7d68bc614215 is going to be deleted. [ 1091.175845] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.176103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.223281] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e086b64-be51-49af-ac2c-6312cfa54bf4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.233881] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('225fb705-337d-4abe-9a25-de3a33d5a961',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.259040] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf: rpc.has_security_group_logging(os_id): False [ 1091.262127] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.262309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.263234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.263348] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 is going to be deleted. [ 1091.264224] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.264446] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.273604] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ae58702-5520-4afd-abbd-064c34515d9b: rpc.has_security_group_logging(os_id): False [ 1091.307800] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.307800] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.331996] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.332337] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.347444] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.347689] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.403913] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.404392] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c19f5e9b-e818-4af4-9417-0ddc1f2e116c is going to be deleted. [ 1091.405431] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.405698] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.462376] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.463236] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1780a9d7-a751-45c5-b020-85c8fdadacd9 is going to be deleted. [ 1091.464610] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.464834] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.502673] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.502884] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.521465] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.521635] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be deleted. [ 1091.522804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.523166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.571682] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.571818] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.573148] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.573266] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b24a2070-f252-45c0-aead-3c64371a04f8 is going to be deleted. [ 1091.574589] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3844e5d-1857-4823-ae42-ffaed25f95f9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.576685] env[69920]: INFO networking_nsxv3.common.synchronization [req-c75d50ae-6288-4768-9054-321d58814227 req-ef8a5ad7-2fa7-419b-81c3-cea492303111 tempest-ServersNegativeTestJSON-1512944231 tempest-ServersNegativeTestJSON-1512944231-project-member] Enqueued Resource ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 with Priority: HIGHEST for action security_group_members [ 1091.577579] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.578055] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.579744] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 with Priority: HIGHEST for action security_group_members [ 1091.580784] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff50f1ab-6b6a-400e-a79f-0d29ae875687 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.580922] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.580970] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.581198] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.581368] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.581474] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.581535] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.581687] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.581768] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.582655] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.633323] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.633483] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.655825] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.656080] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1 is going to be deleted. [ 1091.656957] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.657158] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.663327] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.663553] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.721913] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.722289] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e59b5ff-c965-44e5-b635-07a76f775de9 is going to be deleted. [ 1091.722913] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.723157] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.732358] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e086b64-be51-49af-ac2c-6312cfa54bf4: rpc.has_security_group_logging(os_id): False [ 1091.738167] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 225fb705-337d-4abe-9a25-de3a33d5a961: rpc.has_security_group_logging(os_id): False [ 1091.784085] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.784346] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.785038] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.785137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.785797] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.785797] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.789067] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.789198] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82051f94-9eeb-470d-aa42-9e827049069f is going to be deleted. [ 1091.790121] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.790369] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.819135] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.819321] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.833732] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.833915] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e86ba42-7c29-4732-915b-33713b63d0b7 is going to be deleted. [ 1091.834874] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.835113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.835206] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.835321] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cbc5f86-4dd3-4809-8201-0103be329ab2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.836353] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.836463] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.836637] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.836853] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.836966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.837165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e59b5ff-c965-44e5-b635-07a76f775de9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.837342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.837540] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.837628] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.837801] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32db8592-539e-44ed-a2b9-910bd1e0f62f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.838383] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.838641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.839306] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.839484] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.840038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.840262] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.840376] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.840524] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33cfaadf-9929-4bc4-a275-43f890595f10" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.840675] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.840850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.840954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.841120] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e4e49fe-262d-48ee-b5e7-13fdf4d2aa3f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.841285] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.841457] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.841561] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.841749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d847f61-da82-4a79-82ae-c393059854e9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.841898] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.842088] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.871358] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.871708] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.871817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.871894] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.872091] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.872182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.872265] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b is going to be updated. [ 1091.873371] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.873583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.873631] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.873764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6124cb4-db5b-4093-b85f-7d68bc614215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.873872] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.875868] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.876017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.876219] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.876446] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.876655] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.876772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.876921] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1780a9d7-a751-45c5-b020-85c8fdadacd9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.877082] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.877262] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.877367] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.877540] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c19f5e9b-e818-4af4-9417-0ddc1f2e116c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.878233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.878435] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.878550] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.878770] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.878928] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.879117] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.879243] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.879392] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b24a2070-f252-45c0-aead-3c64371a04f8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.879579] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.879786] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.959690] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.960076] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.960345] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.960345] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.960437] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.960514] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.960615] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 225fb705-337d-4abe-9a25-de3a33d5a961 is going to be updated. [ 1091.961778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.961987] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.962090] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.962215] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7ffbe59-0325-4fc4-bff1-02e9d3c6c5a1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.962353] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.962517] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.000336] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.000623] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.028851] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.031777] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.031777] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.031777] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.031777] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.031777] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.031777] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf is going to be updated. [ 1092.031777] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.031777] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.081053] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.081346] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.081346] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.081504] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.081598] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.081702] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3844e5d-1857-4823-ae42-ffaed25f95f9 is going to be created. [ 1092.084557] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.088723] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.088913] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.090582] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.092448] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.092448] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.092448] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.092448] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.092448] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.092448] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 is going to be updated. [ 1092.094172] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.094432] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.094528] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.094651] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82051f94-9eeb-470d-aa42-9e827049069f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.095029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.095231] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.095311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.095462] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e86ba42-7c29-4732-915b-33713b63d0b7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.120344] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.120567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.120567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.120768] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.120915] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.144983] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.145364] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.145364] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.145718] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.145815] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.184439] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: IN_PROGRESS for 2s [ 1092.201382] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.201740] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.201740] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.201912] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.201968] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.222251] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3844e5d-1857-4823-ae42-ffaed25f95f9 in Status: UNINITIALIZED for 2s [ 1092.225712] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 225fb705-337d-4abe-9a25-de3a33d5a961 in Status: IN_PROGRESS for 2s [ 1092.240163] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.240473] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.240473] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.240621] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.240792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.286895] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.287078] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.287225] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.287449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.287789] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.290178] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf in Status: IN_PROGRESS for 2s [ 1092.311409] env[69920]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1092.311924] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 in Status: IN_PROGRESS for 2s [ 1092.586796] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.909921] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 in Status: SUCCESS [ 1092.909921] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 394b8a58-53d4-4ddb-998c-b2810a22cd53 deletion is rescheduled due to dependency. [ 1092.910370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-394b8a58-53d4-4ddb-998c-b2810a22cd53" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.089583] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.089583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.089583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.089753] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.089840] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.090016] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 is going to be updated. [ 1093.124488] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.124488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.124488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.124488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.124488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.134469] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 in Status: IN_PROGRESS for 2s [ 1093.262199] env[69920]: INFO networking_nsxv3.common.synchronization [req-52d99673-b8aa-4094-9058-c0ce52bc1343 req-f00cb7bb-c324-45a4-93a9-eea1c953a156 tempest-ServerDiskConfigTestJSON-714416826 tempest-ServerDiskConfigTestJSON-714416826-project-member] Enqueued Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 1093.262199] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 1093.262535] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.262818] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.262973] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.263294] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.263564] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.263800] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.263981] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.264318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.264541] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.264753] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.769235] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.769235] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.769235] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.769235] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.769235] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.769235] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.770402] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.770402] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.770402] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.770402] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.770402] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 is going to be deleted. [ 1093.808073] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.808219] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.808333] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.808506] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.808655] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.808768] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.856685] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-538 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.856884] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-538" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.857028] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-538" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.857313] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-538" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.857640] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.857811] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.857930] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.858789] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.859136] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.859347] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1093.859503] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1093.859673] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1093.860597] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1093.860597] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1093.860597] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1093.860597] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1093.882774] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1093.882774] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1093.882963] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1093.883197] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-538" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.883532] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-216a398c-956e-4115-ae6d-b045d946831b taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.884106] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-216a398c-956e-4115-ae6d-b045d946831b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.884106] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-216a398c-956e-4115-ae6d-b045d946831b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.884286] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-216a398c-956e-4115-ae6d-b045d946831b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.884378] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('216a398c-956e-4115-ae6d-b045d946831b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.207258] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: SUCCESS [ 1094.207651] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.234690] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3844e5d-1857-4823-ae42-ffaed25f95f9 in Status: SUCCESS [ 1094.234945] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.235186] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.235370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.235575] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.235718] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.235764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.235962] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.236024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.236074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.236171] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c3844e5d-1857-4823-ae42-ffaed25f95f9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.242121] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 225fb705-337d-4abe-9a25-de3a33d5a961 in Status: SUCCESS [ 1094.242325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.307413] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf in Status: SUCCESS [ 1094.307809] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.341855] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 in Status: SUCCESS [ 1094.342146] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.387466] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.387790] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.387963] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.388265] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.388420] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.388601] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 216a398c-956e-4115-ae6d-b045d946831b not found, creating... [ 1094.388890] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.389072] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.389284] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.389711] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.389774] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.390122] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.390304] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.390415] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.390647] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.390793] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.390945] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 216a398c-956e-4115-ae6d-b045d946831b is going to be created. [ 1094.417013] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.417310] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.417479] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.417821] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.418434] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.418434] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-216a398c-956e-4115-ae6d-b045d946831b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.739114] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3844e5d-1857-4823-ae42-ffaed25f95f9 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.739304] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.739351] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.739593] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.739757] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.739890] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.739990] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.740342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.740342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.740342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.740498] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3844e5d-1857-4823-ae42-ffaed25f95f9 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.740614] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.740687] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.740907] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.741103] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.741170] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.741227] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.741370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.741446] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.741528] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.741624] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c3844e5d-1857-4823-ae42-ffaed25f95f9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.066880] env[69920]: INFO networking_nsxv3.common.synchronization [req-7ecbb82a-ca7d-49e5-bbf8-e56d60f57968 req-000f7967-efec-4794-b705-2c86509319ec tempest-AttachVolumeTestJSON-218421131 tempest-AttachVolumeTestJSON-218421131-project-member] Enqueued Resource ID: 225fb705-337d-4abe-9a25-de3a33d5a961 with Priority: HIGHEST for action security_group_members [ 1095.067659] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 225fb705-337d-4abe-9a25-de3a33d5a961 with Priority: HIGHEST for action security_group_members [ 1095.068181] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-225fb705-337d-4abe-9a25-de3a33d5a961 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.068413] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.068606] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.068928] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.069182] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.069348] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.069455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.069780] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.069956] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.070132] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('225fb705-337d-4abe-9a25-de3a33d5a961',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.147622] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 in Status: SUCCESS [ 1095.147880] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.244113] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c3844e5d-1857-4823-ae42-ffaed25f95f9: rpc.has_security_group_logging(os_id): False [ 1095.247660] env[69920]: INFO networking_nsxv3.common.synchronization [req-52d99673-b8aa-4094-9058-c0ce52bc1343 req-0827e9b7-8e63-4db1-a488-8dfee676e737 service nova] Enqueued Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_rules [ 1095.247882] env[69920]: INFO networking_nsxv3.common.synchronization [req-52d99673-b8aa-4094-9058-c0ce52bc1343 req-0827e9b7-8e63-4db1-a488-8dfee676e737 service nova] Enqueued Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 1095.248094] env[69920]: INFO networking_nsxv3.common.synchronization [req-52d99673-b8aa-4094-9058-c0ce52bc1343 req-0827e9b7-8e63-4db1-a488-8dfee676e737 service nova] Enqueued Resource ID: 216a398c-956e-4115-ae6d-b045d946831b with Priority: HIGHEST for action port [ 1095.250129] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_rules [ 1095.250129] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 1095.250129] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 216a398c-956e-4115-ae6d-b045d946831b with Priority: HIGHEST for action port [ 1095.250129] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.250129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.250129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.250129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.250129] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.252232] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.252232] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.252232] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.252232] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.252232] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.252232] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.252232] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.252232] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.252232] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.252232] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.253702] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-216a398c-956e-4115-ae6d-b045d946831b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.254151] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-216a398c-956e-4115-ae6d-b045d946831b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.254151] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-216a398c-956e-4115-ae6d-b045d946831b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.254247] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-216a398c-956e-4115-ae6d-b045d946831b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.254797] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('216a398c-956e-4115-ae6d-b045d946831b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.264346] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.265031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.265266] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.265542] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.265689] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.265993] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.266158] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.266231] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.266776] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.266776] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.266776] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.266916] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.266916] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.266993] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.267277] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.267529] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.267737] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.267841] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.267999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.268117] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.268226] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3844e5d-1857-4823-ae42-ffaed25f95f9 is going to be created. [ 1095.361888] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.362130] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.362130] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.362333] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.362518] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.375516] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3844e5d-1857-4823-ae42-ffaed25f95f9 in Status: IN_PROGRESS for 2s [ 1095.575520] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.575718] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.575794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.576030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.576126] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.576333] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.576433] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.576494] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.576653] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.576732] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.576819] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 225fb705-337d-4abe-9a25-de3a33d5a961 is going to be updated. [ 1095.668421] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.668634] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.668634] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.668841] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.668975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.679420] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 225fb705-337d-4abe-9a25-de3a33d5a961 in Status: IN_PROGRESS for 2s [ 1095.719580] env[69920]: INFO networking_nsxv3.common.synchronization [req-e9470d1c-25b0-49a5-929e-d9ee378efe5d req-3f4ea237-12ed-41cb-9ee6-16c35ed42c13 tempest-DeleteServersTestJSON-1690074738 tempest-DeleteServersTestJSON-1690074738-project-member] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 1095.720137] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 1095.720434] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.720560] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.722017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.722017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.722017] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.722017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.722017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.722017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.722017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.722017] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.757337] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.757337] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.757337] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.758330] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 216a398c-956e-4115-ae6d-b045d946831b with status ACTIVE [ 1095.759013] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.759013] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.759108] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.759318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.759411] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.759644] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.759749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.759786] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.759959] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.760170] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.760611] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.760778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.760873] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.761091] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.761259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.761337] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 216a398c-956e-4115-ae6d-b045d946831b is going to be updated. [ 1095.787237] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.787394] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.787466] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.787770] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.787914] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.788109] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-216a398c-956e-4115-ae6d-b045d946831b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.066301] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-105 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.066502] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.066633] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.066903] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.067222] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.067388] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.067512] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.067847] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.068043] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.068342] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1096.068465] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1096.068607] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1096.068725] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1096.068844] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1096.068954] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1096.069105] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1096.100602] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1096.100782] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1096.100927] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1096.101129] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.101453] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-6be5b0c0-f02c-4af2-9ca7-f5792eb7bfbd taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.101631] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-6be5b0c0-f02c-4af2-9ca7-f5792eb7bfbd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.101759] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-6be5b0c0-f02c-4af2-9ca7-f5792eb7bfbd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.102263] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-6be5b0c0-f02c-4af2-9ca7-f5792eb7bfbd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.102418] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6be5b0c0-f02c-4af2-9ca7-f5792eb7bfbd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.224496] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.224850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.224850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.224961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.225096] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.225246] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.225415] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.225415] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.225568] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.225641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.225727] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be deleted. [ 1096.264175] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.283026] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.283026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.283026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.283026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.283026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.283026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.412580] env[69920]: INFO networking_nsxv3.common.synchronization [req-0800302e-7454-48bd-8c75-d88c9b9203a8 req-1ca02b77-d73f-4587-9b7f-20d5e700476a tempest-AttachInterfacesTestJSON-901858583 tempest-AttachInterfacesTestJSON-901858583-project-member] Enqueued Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 1096.412580] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 1096.412580] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.412580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.412580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.412580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.412580] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.412580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.412580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.412580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.412580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.412580] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.604852] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.605128] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.605286] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.605604] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.605855] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.605960] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 6be5b0c0-f02c-4af2-9ca7-f5792eb7bfbd not found, creating... [ 1096.606247] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.606439] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.606569] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.606850] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.607040] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.607348] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.607521] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.607745] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.607977] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.608313] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.608508] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 6be5b0c0-f02c-4af2-9ca7-f5792eb7bfbd is going to be created. [ 1096.631705] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.631966] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.632130] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.632416] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.632663] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.632898] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-6be5b0c0-f02c-4af2-9ca7-f5792eb7bfbd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.766158] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.767057] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.767057] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.767057] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.767057] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.767057] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 is going to be created. [ 1096.797997] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.798221] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.799027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.799027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.799027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.819484] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: UNINITIALIZED for 2s [ 1096.882465] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.882678] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.883721] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.883721] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.883721] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.887357] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.887495] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.887827] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.887986] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.888227] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1096.888342] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1096.888452] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1096.888565] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1096.888734] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1096.888937] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1096.889137] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1096.916584] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1096.916785] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1096.916942] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1096.917140] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.917469] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-5e16c6cd-8c81-4e94-97f0-79a4834e6c6f taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.917985] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-5e16c6cd-8c81-4e94-97f0-79a4834e6c6f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.917985] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-5e16c6cd-8c81-4e94-97f0-79a4834e6c6f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.918223] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-5e16c6cd-8c81-4e94-97f0-79a4834e6c6f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.918680] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e16c6cd-8c81-4e94-97f0-79a4834e6c6f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.919705] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.919789] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.919860] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.920081] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.959069] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.959403] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.959588] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.959928] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.960281] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.960460] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.960543] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 is going to be updated. [ 1097.001042] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.001308] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.001430] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.001750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.001993] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.024890] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: IN_PROGRESS for 2s [ 1097.359244] env[69920]: INFO networking_nsxv3.common.synchronization [req-e9470d1c-25b0-49a5-929e-d9ee378efe5d req-21c7dad1-6b1d-47b1-9e90-516bcc5f9e9b service nova] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_rules [ 1097.359244] env[69920]: INFO networking_nsxv3.common.synchronization [req-e9470d1c-25b0-49a5-929e-d9ee378efe5d req-21c7dad1-6b1d-47b1-9e90-516bcc5f9e9b service nova] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 1097.359244] env[69920]: INFO networking_nsxv3.common.synchronization [req-e9470d1c-25b0-49a5-929e-d9ee378efe5d req-21c7dad1-6b1d-47b1-9e90-516bcc5f9e9b service nova] Enqueued Resource ID: 6be5b0c0-f02c-4af2-9ca7-f5792eb7bfbd with Priority: HIGHEST for action port [ 1097.360267] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_rules [ 1097.360474] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 1097.360911] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6be5b0c0-f02c-4af2-9ca7-f5792eb7bfbd with Priority: HIGHEST for action port [ 1097.361523] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.361661] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.361791] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.362426] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.363084] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.364545] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.364731] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.365451] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.365451] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.365451] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.366013] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.366013] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.366124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.366368] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.366416] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.367759] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-6be5b0c0-f02c-4af2-9ca7-f5792eb7bfbd taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.368228] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6be5b0c0-f02c-4af2-9ca7-f5792eb7bfbd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.368228] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6be5b0c0-f02c-4af2-9ca7-f5792eb7bfbd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.369399] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6be5b0c0-f02c-4af2-9ca7-f5792eb7bfbd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.369399] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6be5b0c0-f02c-4af2-9ca7-f5792eb7bfbd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.392894] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3844e5d-1857-4823-ae42-ffaed25f95f9 in Status: SUCCESS [ 1097.393145] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.422857] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.423188] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.423404] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.423788] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.424019] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.424232] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 5e16c6cd-8c81-4e94-97f0-79a4834e6c6f not found, creating... [ 1097.424556] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.424798] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.425505] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.425505] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.425505] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.425858] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.426068] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.426252] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.426547] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.426727] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.426945] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 5e16c6cd-8c81-4e94-97f0-79a4834e6c6f is going to be created. [ 1097.450887] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.451095] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.451367] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.451520] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.451952] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.452037] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-5e16c6cd-8c81-4e94-97f0-79a4834e6c6f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.693277] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 225fb705-337d-4abe-9a25-de3a33d5a961 in Status: SUCCESS [ 1097.693413] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 225fb705-337d-4abe-9a25-de3a33d5a961 deletion is rescheduled due to dependency. [ 1097.693471] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.871299] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.872401] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.872639] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.872858] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6be5b0c0-f02c-4af2-9ca7-f5792eb7bfbd with status ACTIVE [ 1097.873033] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.873146] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.873212] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.873425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.873513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.873683] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.873780] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.873845] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.873999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.874094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.874287] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.874383] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.874442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.874606] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.874681] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.874767] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6be5b0c0-f02c-4af2-9ca7-f5792eb7bfbd is going to be updated. [ 1097.903183] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.903347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.903404] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.903627] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.903801] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.903985] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6be5b0c0-f02c-4af2-9ca7-f5792eb7bfbd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.222651] env[69920]: INFO networking_nsxv3.common.synchronization [req-0800302e-7454-48bd-8c75-d88c9b9203a8 req-768faf06-a0dd-4235-acf2-5fe05992edc1 service nova] Enqueued Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_rules [ 1098.222772] env[69920]: INFO networking_nsxv3.common.synchronization [req-0800302e-7454-48bd-8c75-d88c9b9203a8 req-768faf06-a0dd-4235-acf2-5fe05992edc1 service nova] Enqueued Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 1098.222909] env[69920]: INFO networking_nsxv3.common.synchronization [req-0800302e-7454-48bd-8c75-d88c9b9203a8 req-768faf06-a0dd-4235-acf2-5fe05992edc1 service nova] Enqueued Resource ID: 5e16c6cd-8c81-4e94-97f0-79a4834e6c6f with Priority: HIGHEST for action port [ 1098.223616] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_rules [ 1098.223783] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 1098.223842] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e16c6cd-8c81-4e94-97f0-79a4834e6c6f with Priority: HIGHEST for action port [ 1098.224215] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.224338] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.224406] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.224603] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.224682] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.225632] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.225757] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.225957] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e16c6cd-8c81-4e94-97f0-79a4834e6c6f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.226077] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e16c6cd-8c81-4e94-97f0-79a4834e6c6f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.226126] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e16c6cd-8c81-4e94-97f0-79a4834e6c6f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.226300] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e16c6cd-8c81-4e94-97f0-79a4834e6c6f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.226373] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e16c6cd-8c81-4e94-97f0-79a4834e6c6f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.373304] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.727941] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.729087] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.729087] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e16c6cd-8c81-4e94-97f0-79a4834e6c6f with status ACTIVE [ 1098.729087] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.729087] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.729087] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.729397] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.729397] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.729730] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.729730] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.729730] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.731094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.731094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.731094] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.731094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.731094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.731094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.731094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.731094] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e16c6cd-8c81-4e94-97f0-79a4834e6c6f is going to be updated. [ 1098.754383] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.754580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.754580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.754799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.754938] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.755115] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e16c6cd-8c81-4e94-97f0-79a4834e6c6f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.841592] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: SUCCESS [ 1098.841830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.841998] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.842337] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.842517] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.842637] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.842946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.842946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.843049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.843146] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.843226] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.876139] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.876325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.876400] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.876633] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.876722] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.876819] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be created. [ 1098.922147] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.922326] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.922361] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.922591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.922756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.936574] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: UNINITIALIZED for 2s [ 1099.035612] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: SUCCESS [ 1099.036204] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 deletion is rescheduled due to dependency. [ 1099.036471] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.038012] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.038012] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.038012] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.038012] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.038012] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.038310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.038435] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.038597] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.347901] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.348142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.348245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.348464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.348768] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.348962] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.350085] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.350085] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.350085] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.350085] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.350085] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.350085] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.350085] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.350085] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.350398] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.351061] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.351061] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.351061] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.351061] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.351061] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.351061] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.541887] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.853617] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7eba410e-a0d6-4873-9363-054f457d21d4: rpc.has_security_group_logging(os_id): False [ 1099.876037] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.876179] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.876179] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.880023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.880023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.880023] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.880023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.880023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.880023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.880023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.880023] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.880023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.880363] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.880363] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.880668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.880668] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.880668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.880769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.880869] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.880937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.881052] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 is going to be created. [ 1099.967291] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.967456] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.967494] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.967766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.967950] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.991411] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: IN_PROGRESS for 2s [ 1100.044735] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.301042] env[69920]: INFO networking_nsxv3.common.synchronization [req-5e05c02c-cacd-4f19-85d0-533185422273 req-2e5373d1-fd4d-4a2f-852f-6b5e31a596a7 tempest-ImagesTestJSON-210893687 tempest-ImagesTestJSON-210893687-project-member] Enqueued Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 1100.301042] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 1100.301042] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.301042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.301042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.301530] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.301530] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.301530] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.302640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.302640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.302640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.302640] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.548163] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.548544] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.548544] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.548633] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.548748] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.548884] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 is going to be updated. [ 1100.577830] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.577978] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.578047] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.578262] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.578397] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.591445] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: IN_PROGRESS for 2s [ 1100.763026] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-203 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.763026] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-203" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.763026] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-203" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.763213] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-203" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.763354] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.763519] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.763662] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.763887] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.764052] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.764266] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1100.764385] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1100.764498] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1100.764610] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1100.764725] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1100.764836] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1100.764972] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1100.783973] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1100.784203] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1100.784354] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1100.784563] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-203" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.784937] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-c8607f3f-9b4c-4c0f-b6ab-590d290cf0f1 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.785145] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-c8607f3f-9b4c-4c0f-b6ab-590d290cf0f1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.785279] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-c8607f3f-9b4c-4c0f-b6ab-590d290cf0f1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.785674] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-c8607f3f-9b4c-4c0f-b6ab-590d290cf0f1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.785849] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8607f3f-9b4c-4c0f-b6ab-590d290cf0f1',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.804434] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.804596] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.804642] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.804850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.824793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.825026] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.825136] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.825211] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.825415] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.825530] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.825631] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 is going to be updated. [ 1100.852533] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.852688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.852760] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.852969] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.853121] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.862520] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: IN_PROGRESS for 2s [ 1100.953782] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: SUCCESS [ 1100.953782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.953782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.953782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.953782] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.953782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.953782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.953782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.953782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.953782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.954125] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.288759] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.289018] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.289160] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.289484] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.289702] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.289869] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port c8607f3f-9b4c-4c0f-b6ab-590d290cf0f1 not found, creating... [ 1101.290187] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.290381] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.290505] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.290778] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.290927] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.291265] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.291474] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.291597] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.291830] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.291989] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.292147] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: c8607f3f-9b4c-4c0f-b6ab-590d290cf0f1 is going to be created. [ 1101.313071] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.313315] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.313467] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.313842] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.314145] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.314458] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-c8607f3f-9b4c-4c0f-b6ab-590d290cf0f1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.461662] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.461662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.461662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.461662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.461662] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.461662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.461662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.461662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.462144] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.462144] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.462665] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.462665] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.462665] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.462956] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.463261] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.463408] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.463592] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.463878] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.464050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.464261] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.464475] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.968800] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fdaff9b-63be-497c-8622-3160e739856a: rpc.has_security_group_logging(os_id): False [ 1101.996230] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.996409] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.996461] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.996673] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.996767] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.996976] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.997091] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.997154] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.997304] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.997382] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.997562] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.997673] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.997742] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.997876] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.997951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.000856] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.000971] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.001047] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.001207] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.001286] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.001377] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be created. [ 1102.033737] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: SUCCESS [ 1102.033972] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.076886] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.077088] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.077148] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.077370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.077567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.093595] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: IN_PROGRESS for 2s [ 1102.353839] env[69920]: INFO networking_nsxv3.common.synchronization [req-5e05c02c-cacd-4f19-85d0-533185422273 req-d97b4124-9417-4111-a861-1d2beb649c1c service nova] Enqueued Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_rules [ 1102.354052] env[69920]: INFO networking_nsxv3.common.synchronization [req-5e05c02c-cacd-4f19-85d0-533185422273 req-d97b4124-9417-4111-a861-1d2beb649c1c service nova] Enqueued Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 1102.354202] env[69920]: INFO networking_nsxv3.common.synchronization [req-5e05c02c-cacd-4f19-85d0-533185422273 req-d97b4124-9417-4111-a861-1d2beb649c1c service nova] Enqueued Resource ID: c8607f3f-9b4c-4c0f-b6ab-590d290cf0f1 with Priority: HIGHEST for action port [ 1102.354439] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_rules [ 1102.354567] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 1102.354670] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8607f3f-9b4c-4c0f-b6ab-590d290cf0f1 with Priority: HIGHEST for action port [ 1102.357297] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.357428] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.357500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.357740] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.357828] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.358862] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.358862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.359113] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8607f3f-9b4c-4c0f-b6ab-590d290cf0f1 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.359260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8607f3f-9b4c-4c0f-b6ab-590d290cf0f1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.359362] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8607f3f-9b4c-4c0f-b6ab-590d290cf0f1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.359609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8607f3f-9b4c-4c0f-b6ab-590d290cf0f1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.359718] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8607f3f-9b4c-4c0f-b6ab-590d290cf0f1',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.602122] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: SUCCESS [ 1102.602814] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.602814] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.602951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.603093] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.603274] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.603345] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.603573] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.603662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.603765] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.604298] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.863601] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.863837] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.864012] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c8607f3f-9b4c-4c0f-b6ab-590d290cf0f1 with status ACTIVE [ 1102.864139] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.864249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.864316] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.864553] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.864643] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.865396] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.865396] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.865396] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.865396] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.865396] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.865674] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.865674] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.865674] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.865795] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.866015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.866015] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c8607f3f-9b4c-4c0f-b6ab-590d290cf0f1 is going to be updated. [ 1102.877378] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: SUCCESS [ 1102.878029] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 deletion is rescheduled due to dependency. [ 1102.878029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.878222] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.878458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.878700] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.878829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.878914] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.879118] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.879205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.879297] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.889010] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.889190] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.889521] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.889521] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.889622] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.889770] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8607f3f-9b4c-4c0f-b6ab-590d290cf0f1" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.106752] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.107110] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.107110] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.107241] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.107416] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.107520] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.107586] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.107781] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.107868] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.108029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.108121] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.108217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.108278] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.108424] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.108562] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.108656] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.108719] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.108853] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.108931] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.109036] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.109163] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.381581] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.440977] env[69920]: INFO networking_nsxv3.common.synchronization [None req-18171911-f0ca-4432-8d9f-b38cf6d8d158 tempest-AttachInterfacesTestJSON-901858583 tempest-AttachInterfacesTestJSON-901858583-project-member] Enqueued Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 1103.441419] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 1103.441735] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.441857] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.441927] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.442146] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.442296] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.442411] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.442474] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.442627] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.442714] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.442810] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.611615] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a9f1a73-f43f-451c-8ce2-328d0b73b769: rpc.has_security_group_logging(os_id): False [ 1103.643337] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.643531] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.643531] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.643763] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.643853] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.644060] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.644165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.644230] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.644403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.644504] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.644701] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.644799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.644860] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.645013] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.645121] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.645417] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.645525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.645591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.645747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.645858] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.645954] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 is going to be updated. [ 1103.772063] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.772236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.772311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.772528] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.772680] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.786420] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: IN_PROGRESS for 2s [ 1103.884068] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.946119] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.109060] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: SUCCESS [ 1104.109383] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.387420] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.387690] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.387790] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.388052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.388166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.388273] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 is going to be updated. [ 1104.422172] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.422698] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.422698] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.422805] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.423040] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.435041] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: IN_PROGRESS for 2s [ 1104.448884] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.707351] env[69920]: INFO networking_nsxv3.common.synchronization [req-aa4b002f-7460-4071-ad3b-1c99c814c89c req-d37f3fe8-d947-4d60-aefc-b753082b7f86 tempest-ServersWithSpecificFlavorTestJSON-1780415271 tempest-ServersWithSpecificFlavorTestJSON-1780415271-project-member] Enqueued Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGHEST for action security_group_members [ 1104.707351] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGHEST for action security_group_members [ 1104.707351] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-81b4d229-34c1-420c-acac-a5e9d44d33e5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.707351] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.708602] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.709521] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.710269] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.710509] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.710675] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.710929] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.711112] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.711287] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81b4d229-34c1-420c-acac-a5e9d44d33e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.951130] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.951291] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.951366] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.951581] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.951725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.951765] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 is going to be updated. [ 1104.983571] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.983737] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.983829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.984121] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.984272] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.995079] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: IN_PROGRESS for 2s [ 1105.149049] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-336 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.149369] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-336" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.149562] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-336" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.149873] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-336" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.150216] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.150416] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.150558] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.150820] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.150988] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.151246] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1105.151388] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1105.151509] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1105.151666] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1105.151874] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1105.152034] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1105.152188] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1105.173439] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1105.173635] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1105.173792] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1105.173998] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-336" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.174374] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-7e7e497c-f90e-44b0-a0dc-e400b4b57c0c taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.174569] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-7e7e497c-f90e-44b0-a0dc-e400b4b57c0c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.174708] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-7e7e497c-f90e-44b0-a0dc-e400b4b57c0c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.175126] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-7e7e497c-f90e-44b0-a0dc-e400b4b57c0c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.175294] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e7e497c-f90e-44b0-a0dc-e400b4b57c0c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.214049] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.214264] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.214322] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.214543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.214633] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.214914] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.215039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.215104] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.215266] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.215670] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.215670] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 is going to be deleted. [ 1105.249748] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.249906] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.249992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.250270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.250372] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.250474] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.678424] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.678732] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.679048] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.679396] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.679626] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.679875] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 7e7e497c-f90e-44b0-a0dc-e400b4b57c0c not found, creating... [ 1105.680316] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.680524] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.680671] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.681128] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.681284] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.681598] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.681771] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.681897] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.682165] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.682315] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.682480] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 7e7e497c-f90e-44b0-a0dc-e400b4b57c0c is going to be created. [ 1105.703645] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.703871] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.703993] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.704295] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.704543] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.706462] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-7e7e497c-f90e-44b0-a0dc-e400b4b57c0c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.809634] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: SUCCESS [ 1105.809882] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.978461] env[69920]: INFO networking_nsxv3.common.synchronization [req-9c14e35c-b087-4ef3-aa4a-73e06b3f0b12 req-8433bda9-f06f-4327-8a08-29f393922627 tempest-ServerTagsTestJSON-1641259867 tempest-ServerTagsTestJSON-1641259867-project-member] Enqueued Resource ID: c3844e5d-1857-4823-ae42-ffaed25f95f9 with Priority: HIGHEST for action security_group_members [ 1105.979029] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3844e5d-1857-4823-ae42-ffaed25f95f9 with Priority: HIGHEST for action security_group_members [ 1105.979334] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3844e5d-1857-4823-ae42-ffaed25f95f9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.979460] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.979514] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.979720] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.979871] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.980037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.980590] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.980798] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.980895] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.981041] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3844e5d-1857-4823-ae42-ffaed25f95f9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.985037] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.985037] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.985037] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.985403] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.985545] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.985719] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.985844] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.986080] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.986240] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.986477] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1105.986594] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1105.986712] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1105.986823] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1105.986936] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1105.987058] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1105.987200] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1106.007719] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1106.007914] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1106.008131] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1106.008328] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.008714] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-0a1c6e4f-540d-4f99-b7a9-06cb3c4271b5 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.008911] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-0a1c6e4f-540d-4f99-b7a9-06cb3c4271b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.009107] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-0a1c6e4f-540d-4f99-b7a9-06cb3c4271b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.009443] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-0a1c6e4f-540d-4f99-b7a9-06cb3c4271b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.009703] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a1c6e4f-540d-4f99-b7a9-06cb3c4271b5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.447434] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: SUCCESS [ 1106.447434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.447434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.447434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.447434] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.447434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.447434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.447434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.447434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.447434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.447434] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.485896] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.485896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.485896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.485896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.485896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.485896] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.485896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.485896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.485896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.485896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.485896] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3844e5d-1857-4823-ae42-ffaed25f95f9 is going to be updated. [ 1106.514300] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.514300] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.514300] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.514300] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.514300] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.514300] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 0a1c6e4f-540d-4f99-b7a9-06cb3c4271b5 not found, creating... [ 1106.514300] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.514300] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.514300] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.514300] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.514300] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.514781] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.514781] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.517104] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.517363] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.517524] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.517656] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 0a1c6e4f-540d-4f99-b7a9-06cb3c4271b5 is going to be created. [ 1106.519445] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.519579] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.519633] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.519773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.519897] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.528334] env[69920]: INFO networking_nsxv3.common.synchronization [req-aa4b002f-7460-4071-ad3b-1c99c814c89c req-d232ac5c-eb85-4efa-a7a0-f2d4c53f56a5 service nova] Enqueued Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGHEST for action security_group_rules [ 1106.528476] env[69920]: INFO networking_nsxv3.common.synchronization [req-aa4b002f-7460-4071-ad3b-1c99c814c89c req-d232ac5c-eb85-4efa-a7a0-f2d4c53f56a5 service nova] Enqueued Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGHEST for action security_group_members [ 1106.528619] env[69920]: INFO networking_nsxv3.common.synchronization [req-aa4b002f-7460-4071-ad3b-1c99c814c89c req-d232ac5c-eb85-4efa-a7a0-f2d4c53f56a5 service nova] Enqueued Resource ID: 7e7e497c-f90e-44b0-a0dc-e400b4b57c0c with Priority: HIGHEST for action port [ 1106.528856] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGHEST for action security_group_rules [ 1106.529034] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGHEST for action security_group_members [ 1106.529087] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e7e497c-f90e-44b0-a0dc-e400b4b57c0c with Priority: HIGHEST for action port [ 1106.529574] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81b4d229-34c1-420c-acac-a5e9d44d33e5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.529704] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.529773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.529953] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.530064] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81b4d229-34c1-420c-acac-a5e9d44d33e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.530896] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-81b4d229-34c1-420c-acac-a5e9d44d33e5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.531012] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.531068] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.531240] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.531380] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.531468] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.531517] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.531654] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.531734] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.531826] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81b4d229-34c1-420c-acac-a5e9d44d33e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.532530] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e7e497c-f90e-44b0-a0dc-e400b4b57c0c taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.532645] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e7e497c-f90e-44b0-a0dc-e400b4b57c0c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.532696] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e7e497c-f90e-44b0-a0dc-e400b4b57c0c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.533318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e7e497c-f90e-44b0-a0dc-e400b4b57c0c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.533318] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e7e497c-f90e-44b0-a0dc-e400b4b57c0c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.534399] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3844e5d-1857-4823-ae42-ffaed25f95f9 in Status: IN_PROGRESS for 2s [ 1106.543192] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.543416] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.543548] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.543820] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.544083] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.544327] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-0a1c6e4f-540d-4f99-b7a9-06cb3c4271b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.949484] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.949654] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.949706] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.949918] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.950102] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.950209] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.950306] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.950421] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.950534] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.950593] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.950736] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.950836] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.950890] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.951107] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.951257] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.951362] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.951416] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.951552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.951634] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.951705] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.951862] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.005952] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: SUCCESS [ 1107.006231] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.034197] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81b4d229-34c1-420c-acac-a5e9d44d33e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.035222] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-81b4d229-34c1-420c-acac-a5e9d44d33e5 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.035447] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.035659] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e7e497c-f90e-44b0-a0dc-e400b4b57c0c with status ACTIVE [ 1107.035825] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.035939] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.036024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.036230] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.036321] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.036489] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.036585] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.036640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.036814] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.036897] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.037073] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.037171] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.037275] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.037436] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.037508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.037566] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e7e497c-f90e-44b0-a0dc-e400b4b57c0c is going to be updated. [ 1107.064333] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.064498] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.064662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.064775] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.064916] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.065142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e7e497c-f90e-44b0-a0dc-e400b4b57c0c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.256633] env[69920]: INFO networking_nsxv3.common.synchronization [req-12907131-57cf-4780-91dd-a5d280b85244 req-613c0172-8550-4a9c-9cb2-fd4127a5196e service nova] Enqueued Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_rules [ 1107.256862] env[69920]: INFO networking_nsxv3.common.synchronization [req-12907131-57cf-4780-91dd-a5d280b85244 req-613c0172-8550-4a9c-9cb2-fd4127a5196e service nova] Enqueued Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 1107.257035] env[69920]: INFO networking_nsxv3.common.synchronization [req-12907131-57cf-4780-91dd-a5d280b85244 req-613c0172-8550-4a9c-9cb2-fd4127a5196e service nova] Enqueued Resource ID: 0a1c6e4f-540d-4f99-b7a9-06cb3c4271b5 with Priority: HIGHEST for action port [ 1107.257628] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_rules [ 1107.257937] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 1107.257976] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a1c6e4f-540d-4f99-b7a9-06cb3c4271b5 with Priority: HIGHEST for action port [ 1107.258272] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.258438] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.258479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.258770] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.258770] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.260122] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.260227] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.260305] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.260489] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.260715] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.260834] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.260907] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.261087] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.261185] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.261264] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.262102] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a1c6e4f-540d-4f99-b7a9-06cb3c4271b5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.262204] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a1c6e4f-540d-4f99-b7a9-06cb3c4271b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.262485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a1c6e4f-540d-4f99-b7a9-06cb3c4271b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.262485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a1c6e4f-540d-4f99-b7a9-06cb3c4271b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.262485] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a1c6e4f-540d-4f99-b7a9-06cb3c4271b5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.454773] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1712776d-764c-405e-85d0-105070b4c2e8: rpc.has_security_group_logging(os_id): False [ 1107.473353] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.473682] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.473682] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.473969] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.473969] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.474522] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.474705] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.474705] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.474921] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.475012] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.475145] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.475295] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.475377] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.475473] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.475543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.475756] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.475867] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.475951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.476069] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.476164] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.476254] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 is going to be updated. [ 1107.536163] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81b4d229-34c1-420c-acac-a5e9d44d33e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.555857] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.555964] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.555964] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.556229] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.556394] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.571992] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: IN_PROGRESS for 2s [ 1107.765739] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.766052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.766507] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.769019] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a1c6e4f-540d-4f99-b7a9-06cb3c4271b5 with status ACTIVE [ 1107.769019] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.769019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.769019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.769019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.769019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.769019] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.769019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.769019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.769019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.769019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.770326] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.770554] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.770714] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.771098] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.771272] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.771440] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a1c6e4f-540d-4f99-b7a9-06cb3c4271b5 is going to be updated. [ 1107.799637] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.801019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.801019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.801019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.801019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.801019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a1c6e4f-540d-4f99-b7a9-06cb3c4271b5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.040400] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.040553] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.040653] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.040832] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.044034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.044034] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 is going to be created. [ 1108.066734] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.068256] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.068256] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.068256] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.068256] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.078184] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 in Status: UNINITIALIZED for 2s [ 1108.275777] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.551139] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3844e5d-1857-4823-ae42-ffaed25f95f9 in Status: SUCCESS [ 1108.554868] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3844e5d-1857-4823-ae42-ffaed25f95f9 deletion is rescheduled due to dependency. [ 1108.554868] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.777801] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.777801] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.777801] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.778014] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.778045] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.778141] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 is going to be updated. [ 1108.815282] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.815489] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.815540] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.815738] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.815890] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.829098] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: IN_PROGRESS for 2s [ 1109.586158] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: SUCCESS [ 1109.586493] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.090606] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 in Status: SUCCESS [ 1110.090970] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.091189] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.091443] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.091663] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.091791] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.091874] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.092111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.092232] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.092610] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.092610] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('81b4d229-34c1-420c-acac-a5e9d44d33e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.595526] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('81b4d229-34c1-420c-acac-a5e9d44d33e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.843648] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: SUCCESS [ 1110.843648] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.843648] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.843648] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.843648] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.843648] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.843648] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.843648] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.843648] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.843648] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.843648] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.008778] env[69920]: INFO networking_nsxv3.common.synchronization [req-367f3af6-9949-4e6d-b80e-fc31b8475702 req-5ad01b14-3ed1-4bff-9b09-f83d4d03d96b tempest-DeleteServersTestJSON-1690074738 tempest-DeleteServersTestJSON-1690074738-project-member] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 1111.009146] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 1111.009909] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.010163] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.010269] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.010513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.010762] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.010916] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.011039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.011267] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.011476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.011538] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.099302] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 81b4d229-34c1-420c-acac-a5e9d44d33e5: rpc.has_security_group_logging(os_id): False [ 1111.116984] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.116984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.116984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.116984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.116984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.116984] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.116984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.116984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.116984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.116984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.117372] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 is going to be created. [ 1111.202123] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.202308] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.202356] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.202552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.202731] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.235830] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 in Status: IN_PROGRESS for 2s [ 1111.346462] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.346462] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.346462] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.346821] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.346821] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.346821] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.346951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.347082] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.347137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.348445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.348445] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.348445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.348445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.348445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.348445] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.348445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.348445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.348445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.348445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.348445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.348445] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.517015] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.517015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.517015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.517015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.517015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.517015] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.517015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.517015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.517015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.517015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.517015] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be updated. [ 1111.542302] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.542493] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.542493] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.542706] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.542845] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.552807] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: IN_PROGRESS for 2s [ 1111.852621] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a9f1a73-f43f-451c-8ce2-328d0b73b769: rpc.has_security_group_logging(os_id): False [ 1111.870611] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.870792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.870867] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.871038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.871136] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.871319] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.871410] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.871472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.871628] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.871704] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.871887] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.872113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.872113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.872257] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.872325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.873612] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.873765] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.873991] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.874192] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.874404] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.874503] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 is going to be updated. [ 1111.942019] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.942182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.942293] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.942522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.942730] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.970262] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: IN_PROGRESS for 2s [ 1112.404189] env[69920]: INFO networking_nsxv3.common.synchronization [None req-243d5933-3db2-4a37-bbc1-828693ce8416 None None] Enqueued Resource ID: 746efc31-af02-4bb7-a44e-fa8584ec6c92 with Priority: HIGHEST for action port [ 1112.404457] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 746efc31-af02-4bb7-a44e-fa8584ec6c92 with Priority: HIGHEST for action port [ 1112.406780] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-746efc31-af02-4bb7-a44e-fa8584ec6c92 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.406902] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-746efc31-af02-4bb7-a44e-fa8584ec6c92" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.406976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-746efc31-af02-4bb7-a44e-fa8584ec6c92" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.407265] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-746efc31-af02-4bb7-a44e-fa8584ec6c92" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.407352] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('746efc31-af02-4bb7-a44e-fa8584ec6c92',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.562590] env[69920]: INFO networking_nsxv3.common.synchronization [req-15a5c114-0a6c-4978-a12e-d1ec89eac3e7 req-e2c17ad1-38d2-4472-8e7e-144f9dc751d2 tempest-ServersTestJSON-738065696 tempest-ServersTestJSON-738065696-project-member] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1112.563257] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1112.563604] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.563604] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.563692] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.563837] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.563995] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.565609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.566053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.566053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.566053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.566053] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.911292] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 746efc31-af02-4bb7-a44e-fa8584ec6c92 [ 1112.911530] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.911823] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.911823] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.912088] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.912088] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.912204] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:746efc31-af02-4bb7-a44e-fa8584ec6c92 already deleted. [ 1112.912269] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-746efc31-af02-4bb7-a44e-fa8584ec6c92" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.070340] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.250830] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-21 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.251053] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.251190] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.251460] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.252701] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.252919] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.253066] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.253337] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.253524] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.253784] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1113.253919] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1113.254052] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1113.254172] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1113.254293] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1113.254405] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1113.254543] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1113.256732] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 in Status: SUCCESS [ 1113.256904] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.280249] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1113.280249] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1113.280249] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1113.280249] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.280249] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-b15acf58-fac9-4e30-aaf1-9b212850bf3e taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.280249] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-b15acf58-fac9-4e30-aaf1-9b212850bf3e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.280249] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-b15acf58-fac9-4e30-aaf1-9b212850bf3e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.280249] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-b15acf58-fac9-4e30-aaf1-9b212850bf3e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.280249] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b15acf58-fac9-4e30-aaf1-9b212850bf3e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.461740] env[69920]: INFO networking_nsxv3.common.synchronization [None req-9690db3a-1ce5-4d57-8186-cbb00e572ed8 tempest-AttachVolumeNegativeTest-700673554 tempest-AttachVolumeNegativeTest-700673554-project-member] Enqueued Resource ID: 26f7f40b-869b-4715-bb99-c61da31c1672 with Priority: HIGHEST for action security_group_rules [ 1113.462337] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26f7f40b-869b-4715-bb99-c61da31c1672 with Priority: HIGHEST for action security_group_rules [ 1113.462643] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26f7f40b-869b-4715-bb99-c61da31c1672 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.462751] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.462789] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.465865] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.465991] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26f7f40b-869b-4715-bb99-c61da31c1672',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.558524] env[69920]: INFO networking_nsxv3.common.synchronization [None req-593517f2-0c7e-4cce-9c93-8d070520b146 tempest-AttachVolumeNegativeTest-700673554 tempest-AttachVolumeNegativeTest-700673554-project-member] Enqueued Resource ID: 26f7f40b-869b-4715-bb99-c61da31c1672 with Priority: HIGHEST for action security_group_rules [ 1113.558524] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26f7f40b-869b-4715-bb99-c61da31c1672 with Priority: HIGHEST for action security_group_rules [ 1113.558524] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26f7f40b-869b-4715-bb99-c61da31c1672 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.558524] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.570277] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: SUCCESS [ 1113.570277] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a deletion is rescheduled due to dependency. [ 1113.570277] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.573962] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.786035] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.786035] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.786035] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.786035] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.786035] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.786035] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port b15acf58-fac9-4e30-aaf1-9b212850bf3e not found, creating... [ 1113.786035] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.787115] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.787529] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.788312] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.790078] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.790078] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.790078] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.790078] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.790078] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.790078] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.790825] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: b15acf58-fac9-4e30-aaf1-9b212850bf3e is going to be created. [ 1113.823928] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.823928] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.823928] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.823928] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.823928] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.823928] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-b15acf58-fac9-4e30-aaf1-9b212850bf3e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.996649] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: SUCCESS [ 1113.997036] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.997885] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.998054] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.998120] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.998306] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.998392] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.998487] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26f7f40b-869b-4715-bb99-c61da31c1672 already deleted. [ 1113.998572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.998876] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.998932] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.998978] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26f7f40b-869b-4715-bb99-c61da31c1672',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.076248] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.077260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.077260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.077260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.077576] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.077576] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1114.116437] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.116587] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.117270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.117270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.117270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.133320] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1114.521762] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.522198] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.522353] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.523904] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.523904] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.523904] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26f7f40b-869b-4715-bb99-c61da31c1672 already deleted. [ 1114.523904] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.565861] env[69920]: INFO networking_nsxv3.common.synchronization [req-15a5c114-0a6c-4978-a12e-d1ec89eac3e7 req-ea89b371-a938-409e-96fe-49ae34239a4d service nova] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_rules [ 1114.566113] env[69920]: INFO networking_nsxv3.common.synchronization [req-15a5c114-0a6c-4978-a12e-d1ec89eac3e7 req-ea89b371-a938-409e-96fe-49ae34239a4d service nova] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1114.566344] env[69920]: INFO networking_nsxv3.common.synchronization [req-15a5c114-0a6c-4978-a12e-d1ec89eac3e7 req-ea89b371-a938-409e-96fe-49ae34239a4d service nova] Enqueued Resource ID: b15acf58-fac9-4e30-aaf1-9b212850bf3e with Priority: HIGHEST for action port [ 1114.566491] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_rules [ 1114.566636] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1114.566719] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b15acf58-fac9-4e30-aaf1-9b212850bf3e with Priority: HIGHEST for action port [ 1114.568910] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.568910] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.568910] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.568910] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.568910] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.570768] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.570768] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.573583] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-b15acf58-fac9-4e30-aaf1-9b212850bf3e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.573583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b15acf58-fac9-4e30-aaf1-9b212850bf3e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.573583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b15acf58-fac9-4e30-aaf1-9b212850bf3e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.573583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b15acf58-fac9-4e30-aaf1-9b212850bf3e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.573583] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b15acf58-fac9-4e30-aaf1-9b212850bf3e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.076204] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.076565] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.077866] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b15acf58-fac9-4e30-aaf1-9b212850bf3e with status ACTIVE [ 1115.078430] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.081430] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.081430] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.081644] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.081671] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.081896] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.082013] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.082089] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.082257] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.082337] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.082537] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.082628] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.082687] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.082830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.082900] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.083019] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b15acf58-fac9-4e30-aaf1-9b212850bf3e is going to be updated. [ 1115.089664] env[69920]: INFO networking_nsxv3.common.synchronization [None req-4ba79481-1d00-48d3-8139-dce4591bc860 None None] Enqueued Resource ID: a484cfa4-a42e-45c3-98a9-e2def734dcf5 with Priority: HIGHEST for action port [ 1115.091027] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a484cfa4-a42e-45c3-98a9-e2def734dcf5 with Priority: HIGHEST for action port [ 1115.092622] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-a484cfa4-a42e-45c3-98a9-e2def734dcf5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.092773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a484cfa4-a42e-45c3-98a9-e2def734dcf5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.092832] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a484cfa4-a42e-45c3-98a9-e2def734dcf5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.093121] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a484cfa4-a42e-45c3-98a9-e2def734dcf5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.093205] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a484cfa4-a42e-45c3-98a9-e2def734dcf5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.111757] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.111757] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.111757] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.111902] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.115543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.115543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b15acf58-fac9-4e30-aaf1-9b212850bf3e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.138630] env[69920]: INFO networking_nsxv3.common.synchronization [req-18eef147-b91c-41c9-b3b3-6690cf75cf70 req-27f9e937-04a1-4cb2-b469-10d9b339bd88 tempest-ServersAdminTestJSON-859816448 tempest-ServersAdminTestJSON-859816448-project-member] Enqueued Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 1115.139143] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a with Priority: HIGHEST for action security_group_members [ 1115.139461] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-154896d4-d0bc-49e9-8d89-5fcc04260b1a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.139577] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.139642] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.139840] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.139986] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.144579] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.144846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.145285] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.145415] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.145560] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('154896d4-d0bc-49e9-8d89-5fcc04260b1a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.495822] env[69920]: INFO networking_nsxv3.common.synchronization [req-343ad5c2-3b4a-4efc-b052-31623b0fe7b4 req-1ffacbde-d408-4144-8884-a40a31daf59f tempest-ServerActionsV293TestJSON-1763504731 tempest-ServerActionsV293TestJSON-1763504731-project-member] Enqueued Resource ID: bc15688a-089f-4071-9a2b-93e87f28f846 with Priority: HIGHEST for action security_group_members [ 1115.496369] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc15688a-089f-4071-9a2b-93e87f28f846 with Priority: HIGHEST for action security_group_members [ 1115.496664] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc15688a-089f-4071-9a2b-93e87f28f846 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.496785] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.496852] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.497273] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.497444] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.497549] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.497611] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.497817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.497927] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.498033] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc15688a-089f-4071-9a2b-93e87f28f846',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.598984] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a484cfa4-a42e-45c3-98a9-e2def734dcf5 [ 1115.599220] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.599354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.599444] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.599660] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.599747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.599840] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a484cfa4-a42e-45c3-98a9-e2def734dcf5 already deleted. [ 1115.599918] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a484cfa4-a42e-45c3-98a9-e2def734dcf5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.649976] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.650232] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.650326] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.650786] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.672581] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.674436] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.674597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.674668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.674895] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.674984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.675094] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a is going to be updated. [ 1115.709537] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.709688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.709754] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.710117] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.710373] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.721132] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: IN_PROGRESS for 2s [ 1116.001238] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.001495] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.002258] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.002592] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.002775] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.003144] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.003352] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.003491] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.003731] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.003857] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.004035] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc15688a-089f-4071-9a2b-93e87f28f846 already deleted. [ 1116.004242] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.148609] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1116.148609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.148609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.148609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.148609] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.148609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.148609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.148609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.148609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.148609] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.219650] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-625 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.219924] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-625" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.220046] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-625" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.220876] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-625" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.221246] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.221483] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.221868] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.222015] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.222215] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.223047] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1116.223047] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1116.223047] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1116.223047] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1116.223047] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1116.223314] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1116.224030] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1116.264568] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1116.264667] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1116.264862] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1116.265106] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-625" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.265516] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-358ca610-8c4b-4e27-99df-97c37c69074f taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.265828] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-358ca610-8c4b-4e27-99df-97c37c69074f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.266010] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-358ca610-8c4b-4e27-99df-97c37c69074f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.267260] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-358ca610-8c4b-4e27-99df-97c37c69074f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.267260] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('358ca610-8c4b-4e27-99df-97c37c69074f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.653687] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.770442] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.770674] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.770808] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.771190] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.771263] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.771419] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 358ca610-8c4b-4e27-99df-97c37c69074f not found, creating... [ 1116.772970] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.773173] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.773303] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.774800] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.774967] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.775287] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.775453] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.775578] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.775801] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.775944] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.776128] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 358ca610-8c4b-4e27-99df-97c37c69074f is going to be created. [ 1116.804303] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.804303] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.804303] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.804303] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.804303] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.804303] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-358ca610-8c4b-4e27-99df-97c37c69074f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.155938] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.658555] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.661145] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.661145] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.661145] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.661145] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.661145] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1117.692442] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.692442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.692442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.692442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.692442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.701825] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1117.730363] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a in Status: SUCCESS [ 1117.730363] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 154896d4-d0bc-49e9-8d89-5fcc04260b1a deletion is rescheduled due to dependency. [ 1117.730363] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-154896d4-d0bc-49e9-8d89-5fcc04260b1a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.134357] env[69920]: INFO networking_nsxv3.common.synchronization [req-343ad5c2-3b4a-4efc-b052-31623b0fe7b4 req-163f839d-3af7-4297-9922-2c6f25bff4d1 service nova] Enqueued Resource ID: bc15688a-089f-4071-9a2b-93e87f28f846 with Priority: HIGHEST for action security_group_rules [ 1118.134628] env[69920]: INFO networking_nsxv3.common.synchronization [req-343ad5c2-3b4a-4efc-b052-31623b0fe7b4 req-163f839d-3af7-4297-9922-2c6f25bff4d1 service nova] Enqueued Resource ID: bc15688a-089f-4071-9a2b-93e87f28f846 with Priority: HIGHEST for action security_group_members [ 1118.134819] env[69920]: INFO networking_nsxv3.common.synchronization [req-343ad5c2-3b4a-4efc-b052-31623b0fe7b4 req-163f839d-3af7-4297-9922-2c6f25bff4d1 service nova] Enqueued Resource ID: 358ca610-8c4b-4e27-99df-97c37c69074f with Priority: HIGHEST for action port [ 1118.135391] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc15688a-089f-4071-9a2b-93e87f28f846 with Priority: HIGHEST for action security_group_rules [ 1118.135699] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc15688a-089f-4071-9a2b-93e87f28f846 with Priority: HIGHEST for action security_group_members [ 1118.136778] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 358ca610-8c4b-4e27-99df-97c37c69074f with Priority: HIGHEST for action port [ 1118.137190] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc15688a-089f-4071-9a2b-93e87f28f846 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.137361] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.137497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.137779] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.138373] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc15688a-089f-4071-9a2b-93e87f28f846',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.142169] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc15688a-089f-4071-9a2b-93e87f28f846 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.142289] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.142409] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.142566] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.142726] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.142831] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.142881] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.143194] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.143376] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.143376] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc15688a-089f-4071-9a2b-93e87f28f846',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.144335] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-358ca610-8c4b-4e27-99df-97c37c69074f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.145955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-358ca610-8c4b-4e27-99df-97c37c69074f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.145955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-358ca610-8c4b-4e27-99df-97c37c69074f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.145955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-358ca610-8c4b-4e27-99df-97c37c69074f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.145955] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('358ca610-8c4b-4e27-99df-97c37c69074f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.652478] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc15688a-089f-4071-9a2b-93e87f28f846 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.652478] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.652478] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc15688a-089f-4071-9a2b-93e87f28f846',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.652478] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 358ca610-8c4b-4e27-99df-97c37c69074f with status ACTIVE [ 1118.652478] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.652478] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.652478] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.652478] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.652478] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.652478] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.652478] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.652478] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.652478] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.652478] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.653119] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.653119] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.653119] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.653119] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.653624] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.653891] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 358ca610-8c4b-4e27-99df-97c37c69074f is going to be updated. [ 1118.679937] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.679937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.679937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.679937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.679937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.679937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-358ca610-8c4b-4e27-99df-97c37c69074f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.156331] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc15688a-089f-4071-9a2b-93e87f28f846',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.302747] env[69920]: INFO networking_nsxv3.common.synchronization [req-bea9fedc-ee35-4b9f-9e54-b1490a8ad76a req-ca4411cb-3787-4095-9db8-9ecb2d0a5ccf tempest-AttachVolumeShelveTestJSON-389172843 tempest-AttachVolumeShelveTestJSON-389172843-project-member] Enqueued Resource ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf with Priority: HIGHEST for action security_group_members [ 1119.303309] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf with Priority: HIGHEST for action security_group_members [ 1119.303607] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.303725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.303795] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.304012] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.304295] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.304419] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.304481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.304636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.304717] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.304806] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.659134] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.659473] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.659473] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.659592] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.659683] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.659780] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc15688a-089f-4071-9a2b-93e87f28f846 is going to be created. [ 1119.695492] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.695492] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.695492] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.695492] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.695492] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.706976] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc15688a-089f-4071-9a2b-93e87f28f846 in Status: UNINITIALIZED for 2s [ 1119.709718] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1119.709718] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.709880] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.710114] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.710419] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.710835] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.710835] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.710958] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.711092] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.711193] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.711307] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.807316] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.807480] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.807542] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.807738] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.807867] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.808088] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.808182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.808244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.808401] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.808476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.808559] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf is going to be updated. [ 1119.838066] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.838262] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.838305] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.838541] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.838671] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.848911] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf in Status: IN_PROGRESS for 2s [ 1120.214979] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.215195] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.215381] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.215486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.215656] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.215831] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.215896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.216059] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.216153] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.216245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.216424] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.216543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.216660] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.216920] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.217086] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.217182] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.217344] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.217399] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.217459] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.217543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.217636] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.373421] env[69920]: INFO networking_nsxv3.common.synchronization [req-210077ad-405d-4fa0-bfdf-f49176dc11f9 req-962ebfb9-a073-4393-87eb-ea68e5572707 tempest-AttachInterfacesTestJSON-901858583 tempest-AttachInterfacesTestJSON-901858583-project-member] Enqueued Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 1120.373952] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 1120.376437] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.376437] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.376437] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.376437] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.379765] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.379942] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.380756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.383895] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.383895] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.383895] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.723468] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd313130-fb41-4c30-96a8-0facc1385d33: rpc.has_security_group_logging(os_id): False [ 1120.742269] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.742269] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.742269] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.742269] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.761840] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.762174] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.762298] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.762365] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.762567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.762652] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.762842] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.762940] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.763013] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.763164] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.763254] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.763460] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.763555] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.763618] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.763760] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.763837] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.763922] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1120.824757] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.824939] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.824992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.825226] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.825326] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.839145] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1120.883876] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.385756] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.484686] env[69920]: INFO networking_nsxv3.common.synchronization [None req-65ea5ddd-cd56-405b-b7ae-64b66d160126 tempest-AttachInterfacesTestJSON-901858583 tempest-AttachInterfacesTestJSON-901858583-project-member] Enqueued Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 1121.485254] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 1121.485580] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.485672] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.719613] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc15688a-089f-4071-9a2b-93e87f28f846 in Status: SUCCESS [ 1121.719847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.720075] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.720343] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.720556] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.720688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.720749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.720942] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.721042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.721136] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.721723] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc15688a-089f-4071-9a2b-93e87f28f846',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.861198] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf in Status: SUCCESS [ 1121.861496] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf deletion is rescheduled due to dependency. [ 1121.861496] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.888706] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.888877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.888963] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.889217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.889301] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.889401] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 is going to be updated. [ 1121.919506] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.919744] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.919744] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.919937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.920103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.929634] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: IN_PROGRESS for 2s [ 1122.223386] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc15688a-089f-4071-9a2b-93e87f28f846',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.728154] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc15688a-089f-4071-9a2b-93e87f28f846: rpc.has_security_group_logging(os_id): False [ 1122.751222] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.751409] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.751449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.751644] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.751735] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.752028] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.752131] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.752196] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.752357] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.752623] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.752623] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc15688a-089f-4071-9a2b-93e87f28f846 is going to be created. [ 1122.823625] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.823901] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.824024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.824277] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.824489] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.842404] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc15688a-089f-4071-9a2b-93e87f28f846 in Status: IN_PROGRESS for 2s [ 1122.889021] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1122.889345] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.166707] env[69920]: INFO networking_nsxv3.common.synchronization [req-0a2a6d5c-eb2f-419b-a27f-3714aabb8fb6 req-272872c5-fb62-4dd2-9853-3af3dfeaac77 tempest-ImagesTestJSON-210893687 tempest-ImagesTestJSON-210893687-project-member] Enqueued Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 1123.167353] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1712776d-764c-405e-85d0-105070b4c2e8 with Priority: HIGHEST for action security_group_members [ 1123.167702] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-1712776d-764c-405e-85d0-105070b4c2e8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.167829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.167946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.168166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.168327] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.168534] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.168534] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.168682] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.168749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.168962] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1712776d-764c-405e-85d0-105070b4c2e8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.671011] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.671237] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.671326] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.671500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.671586] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.671921] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.672088] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.672193] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.672660] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.672794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.672927] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 is going to be updated. [ 1123.704916] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.705234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.705318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.705562] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.705725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.715946] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: IN_PROGRESS for 2s [ 1123.944020] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: SUCCESS [ 1123.944020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.944020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.944020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.944020] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.944020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.944020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.944020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.944020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.944020] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.447933] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.447933] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.447933] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.447933] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.447933] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.447933] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.447933] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.447933] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.447933] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.447933] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.447933] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 is going to be updated. [ 1124.500266] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.500472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.503509] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.503509] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.503509] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.514910] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: IN_PROGRESS for 2s [ 1124.855581] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc15688a-089f-4071-9a2b-93e87f28f846 in Status: SUCCESS [ 1124.855820] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.365540] env[69920]: INFO networking_nsxv3.common.synchronization [req-5f77e7ec-3f2a-4a85-8484-2af98f558bfb req-67ac2ef4-572a-4f6d-add0-9fd564c61338 tempest-AttachInterfacesTestJSON-901858583 tempest-AttachInterfacesTestJSON-901858583-project-member] Enqueued Resource ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 with Priority: HIGHEST for action security_group_members [ 1125.366296] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 with Priority: HIGHEST for action security_group_members [ 1125.366535] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e086b64-be51-49af-ac2c-6312cfa54bf4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.366644] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.366644] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.368092] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.368092] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.368092] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.368092] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.368092] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.368092] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.368092] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e086b64-be51-49af-ac2c-6312cfa54bf4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.725640] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1712776d-764c-405e-85d0-105070b4c2e8 in Status: SUCCESS [ 1125.726686] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1712776d-764c-405e-85d0-105070b4c2e8 deletion is rescheduled due to dependency. [ 1125.726686] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1712776d-764c-405e-85d0-105070b4c2e8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.872951] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.872951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.872951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.872951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.872951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.872951] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.872951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.872951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.872951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.872951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.872951] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 is going to be updated. [ 1125.899953] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.900108] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.900179] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.900393] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.900534] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.909876] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 in Status: IN_PROGRESS for 2s [ 1126.294504] env[69920]: INFO networking_nsxv3.common.synchronization [req-8fb1b0b8-2615-442a-abca-e740b8edfa3f req-af4f3140-749e-447f-be5a-15e46122e487 tempest-ServerRescueNegativeTestJSON-1943285071 tempest-ServerRescueNegativeTestJSON-1943285071-project-member] Enqueued Resource ID: aca15fc8-3d94-4e24-9796-2477465c9437 with Priority: HIGHEST for action security_group_members [ 1126.295056] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aca15fc8-3d94-4e24-9796-2477465c9437 with Priority: HIGHEST for action security_group_members [ 1126.295365] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-aca15fc8-3d94-4e24-9796-2477465c9437 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.295696] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.295696] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.295801] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.295934] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.298810] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.298810] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.298810] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.298961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.299016] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aca15fc8-3d94-4e24-9796-2477465c9437',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.525870] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: SUCCESS [ 1126.526316] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 deletion is rescheduled due to dependency. [ 1126.526316] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.802326] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.802648] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.802648] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.802818] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.802915] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.803146] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.803283] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.803338] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.803476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.803555] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.803643] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aca15fc8-3d94-4e24-9796-2477465c9437 already deleted. [ 1126.803725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.214763] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-215 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.214763] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.214763] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.214763] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.214763] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.215021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.215192] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.215631] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.215845] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.216138] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.216301] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1127.216674] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1127.216674] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1127.216674] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1127.216856] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1127.217108] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1127.254342] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1127.254660] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1127.254908] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1127.255259] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.256548] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-30a26167-3dd4-4729-be64-03c251eaaa48 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.256548] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-30a26167-3dd4-4729-be64-03c251eaaa48" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.256708] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-30a26167-3dd4-4729-be64-03c251eaaa48" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.257356] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-30a26167-3dd4-4729-be64-03c251eaaa48" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.257594] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30a26167-3dd4-4729-be64-03c251eaaa48',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.765412] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.765635] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.765682] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.765991] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.766200] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.766378] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 30a26167-3dd4-4729-be64-03c251eaaa48 not found, creating... [ 1127.766719] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.766892] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.767031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.767276] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.767422] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.767719] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.767882] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.769793] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.770435] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.770542] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.770743] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 30a26167-3dd4-4729-be64-03c251eaaa48 is going to be created. [ 1127.798058] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.798458] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.798458] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.799268] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.799268] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.800311] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-30a26167-3dd4-4729-be64-03c251eaaa48" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.928838] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 in Status: SUCCESS [ 1127.929189] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 deletion is rescheduled due to dependency. [ 1127.929444] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.074314] env[69920]: INFO networking_nsxv3.common.synchronization [req-a380131e-ab0c-4d17-877c-f1dd96eb681a req-76f87166-02a3-48ee-aa2f-b790876f4623 tempest-ServersTestJSON-738065696 tempest-ServersTestJSON-738065696-project-member] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1128.074958] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1128.075745] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.075952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.076113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.076432] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.076697] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.076912] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.077042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.077209] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.077310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.077412] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.579558] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.718158] env[69920]: INFO networking_nsxv3.common.synchronization [req-8fb1b0b8-2615-442a-abca-e740b8edfa3f req-5910a368-d39a-4186-94b0-2e876b3b295b service nova] Enqueued Resource ID: aca15fc8-3d94-4e24-9796-2477465c9437 with Priority: HIGHEST for action security_group_rules [ 1128.718444] env[69920]: INFO networking_nsxv3.common.synchronization [req-8fb1b0b8-2615-442a-abca-e740b8edfa3f req-5910a368-d39a-4186-94b0-2e876b3b295b service nova] Enqueued Resource ID: aca15fc8-3d94-4e24-9796-2477465c9437 with Priority: HIGHEST for action security_group_members [ 1128.718597] env[69920]: INFO networking_nsxv3.common.synchronization [req-8fb1b0b8-2615-442a-abca-e740b8edfa3f req-5910a368-d39a-4186-94b0-2e876b3b295b service nova] Enqueued Resource ID: 30a26167-3dd4-4729-be64-03c251eaaa48 with Priority: HIGHEST for action port [ 1128.719365] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aca15fc8-3d94-4e24-9796-2477465c9437 with Priority: HIGHEST for action security_group_rules [ 1128.719515] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aca15fc8-3d94-4e24-9796-2477465c9437 with Priority: HIGHEST for action security_group_members [ 1128.719612] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30a26167-3dd4-4729-be64-03c251eaaa48 with Priority: HIGHEST for action port [ 1128.719926] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aca15fc8-3d94-4e24-9796-2477465c9437 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.720074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.720145] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.720428] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.720513] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aca15fc8-3d94-4e24-9796-2477465c9437',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.722241] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-aca15fc8-3d94-4e24-9796-2477465c9437 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.722366] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.722436] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.722658] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.722762] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.722861] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.722927] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.723086] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.723210] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.723364] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aca15fc8-3d94-4e24-9796-2477465c9437',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.724242] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-30a26167-3dd4-4729-be64-03c251eaaa48 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.728024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30a26167-3dd4-4729-be64-03c251eaaa48" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.728024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30a26167-3dd4-4729-be64-03c251eaaa48" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.728024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30a26167-3dd4-4729-be64-03c251eaaa48" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.728024] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30a26167-3dd4-4729-be64-03c251eaaa48',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.081739] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.226872] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aca15fc8-3d94-4e24-9796-2477465c9437',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.228335] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-aca15fc8-3d94-4e24-9796-2477465c9437 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.228427] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.228546] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 30a26167-3dd4-4729-be64-03c251eaaa48 with status ACTIVE [ 1129.228737] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.228847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.232031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.232031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.232031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.232031] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.232031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.232031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.232031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.232031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.232031] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.232031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.232031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.232031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.232031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.232031] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 30a26167-3dd4-4729-be64-03c251eaaa48 is going to be updated. [ 1129.257196] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.257406] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.257482] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.257688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.257822] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.258061] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30a26167-3dd4-4729-be64-03c251eaaa48" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.586625] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.586625] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.586625] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.586625] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.586625] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.586625] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1129.619246] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.619395] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.619465] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.619699] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.619838] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.630821] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1129.733730] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aca15fc8-3d94-4e24-9796-2477465c9437',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.236705] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.237027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.237027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.237259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.237370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.237474] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aca15fc8-3d94-4e24-9796-2477465c9437 is going to be created. [ 1130.271048] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.272041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.272041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.272041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.272041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.283358] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aca15fc8-3d94-4e24-9796-2477465c9437 in Status: UNINITIALIZED for 2s [ 1130.730119] env[69920]: INFO networking_nsxv3.common.synchronization [req-39bc91ae-2ae0-4760-83ae-184d5c9a8190 req-5441c7f9-b607-47f5-93e5-c1a90f244865 tempest-AttachVolumeNegativeTest-700673554 tempest-AttachVolumeNegativeTest-700673554-project-member] Enqueued Resource ID: 26f7f40b-869b-4715-bb99-c61da31c1672 with Priority: HIGHEST for action security_group_members [ 1130.730119] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26f7f40b-869b-4715-bb99-c61da31c1672 with Priority: HIGHEST for action security_group_members [ 1130.730428] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-26f7f40b-869b-4715-bb99-c61da31c1672 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.730595] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.730912] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.730998] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.731241] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.731385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.731480] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.731682] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.731819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.731938] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26f7f40b-869b-4715-bb99-c61da31c1672',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.209279] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.209426] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-861" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.209559] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-861" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.209861] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-861" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.210140] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.210308] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.210430] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.210660] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.210811] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.211211] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1131.211387] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1131.212028] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1131.212028] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1131.212028] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1131.212028] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1131.212028] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1131.234268] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.234463] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.234463] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.234649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.234739] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.234927] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.235103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.235189] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.235353] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.235434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.235524] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26f7f40b-869b-4715-bb99-c61da31c1672 already deleted. [ 1131.235603] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.239023] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1131.239425] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1131.239425] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1131.239857] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-861" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.239857] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-9251f381-f500-4fb3-a407-0020e12af1ec taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.240037] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-9251f381-f500-4fb3-a407-0020e12af1ec" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.240130] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-9251f381-f500-4fb3-a407-0020e12af1ec" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.240450] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-9251f381-f500-4fb3-a407-0020e12af1ec" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.240599] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9251f381-f500-4fb3-a407-0020e12af1ec',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.645103] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1131.645358] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.742869] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.745078] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.745078] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.745078] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.745078] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.745556] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 9251f381-f500-4fb3-a407-0020e12af1ec not found, creating... [ 1131.745556] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.745690] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.745738] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.746020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.746186] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.746497] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.746658] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.746780] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.747009] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.748050] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.748050] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 9251f381-f500-4fb3-a407-0020e12af1ec is going to be created. [ 1131.773423] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.773635] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.773766] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.774067] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.774310] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.774541] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-9251f381-f500-4fb3-a407-0020e12af1ec" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.294051] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aca15fc8-3d94-4e24-9796-2477465c9437 in Status: SUCCESS [ 1132.294390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.294819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.295049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.295359] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.295359] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.295560] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.295560] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.295752] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.295752] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.295816] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aca15fc8-3d94-4e24-9796-2477465c9437',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.524246] env[69920]: INFO networking_nsxv3.common.synchronization [req-39bc91ae-2ae0-4760-83ae-184d5c9a8190 req-f8902fdd-1173-40e6-87b9-fe1920d6a943 service nova] Enqueued Resource ID: 26f7f40b-869b-4715-bb99-c61da31c1672 with Priority: HIGHEST for action security_group_rules [ 1132.524246] env[69920]: INFO networking_nsxv3.common.synchronization [req-39bc91ae-2ae0-4760-83ae-184d5c9a8190 req-f8902fdd-1173-40e6-87b9-fe1920d6a943 service nova] Enqueued Resource ID: 26f7f40b-869b-4715-bb99-c61da31c1672 with Priority: HIGHEST for action security_group_members [ 1132.524246] env[69920]: INFO networking_nsxv3.common.synchronization [req-39bc91ae-2ae0-4760-83ae-184d5c9a8190 req-f8902fdd-1173-40e6-87b9-fe1920d6a943 service nova] Enqueued Resource ID: 9251f381-f500-4fb3-a407-0020e12af1ec with Priority: HIGHEST for action port [ 1132.524246] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26f7f40b-869b-4715-bb99-c61da31c1672 with Priority: HIGHEST for action security_group_rules [ 1132.524690] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26f7f40b-869b-4715-bb99-c61da31c1672 with Priority: HIGHEST for action security_group_members [ 1132.525016] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9251f381-f500-4fb3-a407-0020e12af1ec with Priority: HIGHEST for action port [ 1132.525401] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26f7f40b-869b-4715-bb99-c61da31c1672 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.525673] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.525876] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.526341] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.528591] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26f7f40b-869b-4715-bb99-c61da31c1672',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.528591] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-26f7f40b-869b-4715-bb99-c61da31c1672 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.528591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.528591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.528591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.528591] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.528591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.528591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.528591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.528591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.528591] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26f7f40b-869b-4715-bb99-c61da31c1672',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.529391] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-9251f381-f500-4fb3-a407-0020e12af1ec taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.529488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9251f381-f500-4fb3-a407-0020e12af1ec" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.529552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9251f381-f500-4fb3-a407-0020e12af1ec" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.529696] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9251f381-f500-4fb3-a407-0020e12af1ec" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.529765] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9251f381-f500-4fb3-a407-0020e12af1ec',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.798911] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-aca15fc8-3d94-4e24-9796-2477465c9437 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.799193] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.799193] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.799671] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.799671] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.799671] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.799843] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.799843] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.799915] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.800038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.800176] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-aca15fc8-3d94-4e24-9796-2477465c9437 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.800262] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.800323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.800466] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.800602] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.800694] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.800757] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.800890] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.800969] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.801071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.801210] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aca15fc8-3d94-4e24-9796-2477465c9437',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.902499] env[69920]: INFO networking_nsxv3.common.synchronization [req-6e5384f3-0193-4109-a713-fcd60049f965 req-e59651bd-91f7-4423-b8d3-112ee61ebe57 tempest-ServerRescueNegativeTestJSON-1943285071 tempest-ServerRescueNegativeTestJSON-1943285071-project-member] Enqueued Resource ID: aca15fc8-3d94-4e24-9796-2477465c9437 with Priority: HIGHEST for action security_group_members [ 1132.903340] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aca15fc8-3d94-4e24-9796-2477465c9437 with Priority: HIGHEST for action security_group_members [ 1132.903426] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-aca15fc8-3d94-4e24-9796-2477465c9437 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.903503] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.903570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.903788] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.903973] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.904155] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.904220] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.904417] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.904507] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.904617] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aca15fc8-3d94-4e24-9796-2477465c9437',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.031766] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('26f7f40b-869b-4715-bb99-c61da31c1672',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.032892] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-26f7f40b-869b-4715-bb99-c61da31c1672 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.033041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.033156] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9251f381-f500-4fb3-a407-0020e12af1ec with status ACTIVE [ 1133.033310] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.033415] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.033481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.033683] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.033774] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.034116] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.034116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.034116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.034271] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.034353] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.034534] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.034626] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.034687] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.034829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.034932] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.035097] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9251f381-f500-4fb3-a407-0020e12af1ec is going to be updated. [ 1133.065354] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.065849] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.065938] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.066185] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.066364] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.066541] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9251f381-f500-4fb3-a407-0020e12af1ec" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.240020] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-215 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.240020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.240020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.240020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.240020] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.240020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.240020] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.240528] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.240787] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.241124] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1133.241375] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1133.241591] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1133.241798] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1133.242024] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1133.242229] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1133.242521] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1133.269933] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1133.270159] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1133.270521] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1133.270732] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.271732] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-619d4a4d-a555-4b6b-a00b-87d1eb721427 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.271948] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-619d4a4d-a555-4b6b-a00b-87d1eb721427" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.272101] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-619d4a4d-a555-4b6b-a00b-87d1eb721427" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.272448] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-619d4a4d-a555-4b6b-a00b-87d1eb721427" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.272597] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('619d4a4d-a555-4b6b-a00b-87d1eb721427',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.306949] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aca15fc8-3d94-4e24-9796-2477465c9437: rpc.has_security_group_logging(os_id): False [ 1133.326898] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.327036] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.327115] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.327326] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.327415] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.327621] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.327729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.327780] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.327928] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.328067] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.328262] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.328359] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.328415] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.328575] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.328657] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.328835] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.328931] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.329170] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.330028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.330028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.330028] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aca15fc8-3d94-4e24-9796-2477465c9437 is going to be created. [ 1133.396225] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.396443] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.396443] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.396626] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.396913] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.407673] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aca15fc8-3d94-4e24-9796-2477465c9437',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.409934] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aca15fc8-3d94-4e24-9796-2477465c9437 in Status: IN_PROGRESS for 2s [ 1133.537553] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('26f7f40b-869b-4715-bb99-c61da31c1672',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.775921] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.776211] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.776360] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.776704] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.776876] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.777166] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 619d4a4d-a555-4b6b-a00b-87d1eb721427 not found, creating... [ 1133.777627] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.778065] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.778737] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.779081] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.779361] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.779740] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.780794] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.780794] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.780794] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.780794] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.780794] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 619d4a4d-a555-4b6b-a00b-87d1eb721427 is going to be created. [ 1133.805339] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.805581] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.805724] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.806063] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.806333] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.806729] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-619d4a4d-a555-4b6b-a00b-87d1eb721427" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.910237] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aca15fc8-3d94-4e24-9796-2477465c9437',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.041398] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.041398] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.041398] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.041398] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.041398] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.041398] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26f7f40b-869b-4715-bb99-c61da31c1672 is going to be created. [ 1134.066932] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.067101] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.067191] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.067431] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.067615] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.078498] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26f7f40b-869b-4715-bb99-c61da31c1672 in Status: UNINITIALIZED for 2s [ 1134.412637] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.415603] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.415603] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.415603] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.415603] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.415603] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aca15fc8-3d94-4e24-9796-2477465c9437 is going to be updated. [ 1134.448072] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.448072] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.448072] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.448072] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.448072] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.457755] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aca15fc8-3d94-4e24-9796-2477465c9437 in Status: IN_PROGRESS for 2s [ 1134.598056] env[69920]: INFO networking_nsxv3.common.synchronization [req-6e5384f3-0193-4109-a713-fcd60049f965 req-1cabeab2-4dab-46af-953b-89c9906df7d9 service nova] Enqueued Resource ID: aca15fc8-3d94-4e24-9796-2477465c9437 with Priority: HIGHEST for action security_group_rules [ 1134.598056] env[69920]: INFO networking_nsxv3.common.synchronization [req-6e5384f3-0193-4109-a713-fcd60049f965 req-1cabeab2-4dab-46af-953b-89c9906df7d9 service nova] Enqueued Resource ID: aca15fc8-3d94-4e24-9796-2477465c9437 with Priority: HIGHEST for action security_group_members [ 1134.598056] env[69920]: INFO networking_nsxv3.common.synchronization [req-6e5384f3-0193-4109-a713-fcd60049f965 req-1cabeab2-4dab-46af-953b-89c9906df7d9 service nova] Enqueued Resource ID: 619d4a4d-a555-4b6b-a00b-87d1eb721427 with Priority: HIGHEST for action port [ 1134.598056] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aca15fc8-3d94-4e24-9796-2477465c9437 with Priority: HIGHEST for action security_group_rules [ 1134.598056] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aca15fc8-3d94-4e24-9796-2477465c9437 with Priority: HIGHEST for action security_group_members [ 1134.598056] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 619d4a4d-a555-4b6b-a00b-87d1eb721427 with Priority: HIGHEST for action port [ 1134.598056] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aca15fc8-3d94-4e24-9796-2477465c9437 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.598056] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.598056] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-aca15fc8-3d94-4e24-9796-2477465c9437 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.598056] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.598056] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-619d4a4d-a555-4b6b-a00b-87d1eb721427 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.598056] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-619d4a4d-a555-4b6b-a00b-87d1eb721427" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.598056] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-619d4a4d-a555-4b6b-a00b-87d1eb721427" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.598056] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-619d4a4d-a555-4b6b-a00b-87d1eb721427" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.598056] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('619d4a4d-a555-4b6b-a00b-87d1eb721427',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.100245] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 619d4a4d-a555-4b6b-a00b-87d1eb721427 with status ACTIVE [ 1135.100487] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.100614] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.100781] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.100927] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.101028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.101215] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.101325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.101389] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.101545] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.101624] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.101803] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.101896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.101958] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.102120] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.102198] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.102283] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 619d4a4d-a555-4b6b-a00b-87d1eb721427 is going to be updated. [ 1135.132079] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.132213] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.132213] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.132401] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.132536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.132709] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-619d4a4d-a555-4b6b-a00b-87d1eb721427" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.427504] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aca15fc8-3d94-4e24-9796-2477465c9437 in Status: SUCCESS [ 1135.427504] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.427504] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.427504] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.427504] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aca15fc8-3d94-4e24-9796-2477465c9437',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.641082] env[69920]: INFO networking_nsxv3.common.synchronization [None req-3c2766b4-7f14-4aa1-903d-bce60f42db9c tempest-AttachVolumeShelveTestJSON-389172843 tempest-AttachVolumeShelveTestJSON-389172843-project-member] Enqueued Resource ID: fab6b45f-3ae6-4550-ba52-182144930713 with Priority: HIGHEST for action security_group_rules [ 1135.641640] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab6b45f-3ae6-4550-ba52-182144930713 with Priority: HIGHEST for action security_group_rules [ 1135.641942] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fab6b45f-3ae6-4550-ba52-182144930713 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.642144] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.642220] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.642482] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.642625] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fab6b45f-3ae6-4550-ba52-182144930713',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.728795] env[69920]: INFO networking_nsxv3.common.synchronization [None req-e3d1a95b-2cbf-478a-b096-d51aea8193e8 tempest-AttachVolumeShelveTestJSON-389172843 tempest-AttachVolumeShelveTestJSON-389172843-project-member] Enqueued Resource ID: fab6b45f-3ae6-4550-ba52-182144930713 with Priority: HIGHEST for action security_group_rules [ 1135.728795] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab6b45f-3ae6-4550-ba52-182144930713 with Priority: HIGHEST for action security_group_rules [ 1135.729075] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fab6b45f-3ae6-4550-ba52-182144930713 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.729176] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.930097] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-aca15fc8-3d94-4e24-9796-2477465c9437 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.931578] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.097423] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26f7f40b-869b-4715-bb99-c61da31c1672 in Status: SUCCESS [ 1136.097607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.097791] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.098133] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.098353] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.098468] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.098533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.098706] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.098790] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.098879] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.098970] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('26f7f40b-869b-4715-bb99-c61da31c1672',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.171444] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.171635] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.171635] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.171867] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.171948] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.172059] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fab6b45f-3ae6-4550-ba52-182144930713 already deleted. [ 1136.172148] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.172308] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.172469] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.172553] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fab6b45f-3ae6-4550-ba52-182144930713',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.469820] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aca15fc8-3d94-4e24-9796-2477465c9437 in Status: SUCCESS [ 1136.473038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.473038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.473038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.473038] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.473038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.473038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.473038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.473038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.473038] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aca15fc8-3d94-4e24-9796-2477465c9437',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.601454] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('26f7f40b-869b-4715-bb99-c61da31c1672',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.717570] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.717570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.717570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.717570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.717570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.717570] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fab6b45f-3ae6-4550-ba52-182144930713 already deleted. [ 1136.717570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.803389] env[69920]: INFO networking_nsxv3.common.synchronization [None req-bde0cd24-9e22-48c4-a376-ddf54ef010bf None None] Enqueued Resource ID: f77d1287-b605-4415-b818-5ac49eb49c08 with Priority: HIGHEST for action port [ 1136.803389] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77d1287-b605-4415-b818-5ac49eb49c08 with Priority: HIGHEST for action port [ 1136.803834] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-f77d1287-b605-4415-b818-5ac49eb49c08 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.805951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f77d1287-b605-4415-b818-5ac49eb49c08" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.805951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f77d1287-b605-4415-b818-5ac49eb49c08" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.805951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f77d1287-b605-4415-b818-5ac49eb49c08" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.805951] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f77d1287-b605-4415-b818-5ac49eb49c08',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.976415] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aca15fc8-3d94-4e24-9796-2477465c9437',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.104145] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 26f7f40b-869b-4715-bb99-c61da31c1672: rpc.has_security_group_logging(os_id): False [ 1137.123886] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.123886] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.123886] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.124117] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.124117] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.125070] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.125070] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.125070] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.125070] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.125070] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.125070] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26f7f40b-869b-4715-bb99-c61da31c1672 is going to be created. [ 1137.248430] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.248624] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.248662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.248879] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.249107] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.263174] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26f7f40b-869b-4715-bb99-c61da31c1672 in Status: IN_PROGRESS for 2s [ 1137.307695] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f77d1287-b605-4415-b818-5ac49eb49c08 [ 1137.307927] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.308254] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.308414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.308722] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.308866] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.308978] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f77d1287-b605-4415-b818-5ac49eb49c08 already deleted. [ 1137.309134] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f77d1287-b605-4415-b818-5ac49eb49c08" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.488423] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aca15fc8-3d94-4e24-9796-2477465c9437',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.741658] env[69920]: INFO networking_nsxv3.common.synchronization [None req-cf1df0fc-a2ec-49d6-9227-8f7ed74d99b4 tempest-AttachInterfacesUnderV243Test-1114553105 tempest-AttachInterfacesUnderV243Test-1114553105-project-member] Enqueued Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGHEST for action security_group_rules [ 1137.742104] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGHEST for action security_group_rules [ 1137.742396] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d81f2be6-2daa-4694-bfd3-496e64f467ac taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.742514] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.742580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.742837] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.742914] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.837379] env[69920]: INFO networking_nsxv3.common.synchronization [None req-f33cab29-03ff-49b5-ad9d-c0e7b353ac01 tempest-AttachInterfacesUnderV243Test-1114553105 tempest-AttachInterfacesUnderV243Test-1114553105-project-member] Enqueued Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGHEST for action security_group_rules [ 1137.837788] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGHEST for action security_group_rules [ 1137.838192] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d81f2be6-2daa-4694-bfd3-496e64f467ac taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.838298] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.995318] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.995318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.995485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.995582] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.995699] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.995767] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aca15fc8-3d94-4e24-9796-2477465c9437 is going to be updated. [ 1138.039888] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.040135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.040135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.040314] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.040517] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.055183] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aca15fc8-3d94-4e24-9796-2477465c9437 in Status: IN_PROGRESS for 2s [ 1138.265678] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.265834] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.265921] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.266142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.266237] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.266331] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d81f2be6-2daa-4694-bfd3-496e64f467ac already deleted. [ 1138.266420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.266949] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.266949] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.267065] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.794791] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.795101] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.795101] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.795334] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.795446] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.795570] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d81f2be6-2daa-4694-bfd3-496e64f467ac already deleted. [ 1138.795681] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.281190] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26f7f40b-869b-4715-bb99-c61da31c1672 in Status: SUCCESS [ 1139.281190] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.396720] env[69920]: INFO networking_nsxv3.common.synchronization [req-a6f206f4-aa50-4296-8ff1-5f42569b9d2d req-4f733e89-640c-4b34-b80c-4faab1e0c189 tempest-DeleteServersTestJSON-1690074738 tempest-DeleteServersTestJSON-1690074738-project-member] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 1139.397334] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 1139.397665] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.397789] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.397855] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.398957] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.399295] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.399295] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.399533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.399581] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.399633] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.400113] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.904482] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.904482] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.908440] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.908440] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.908440] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.908440] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.908440] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.908440] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.908440] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.908440] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.908440] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be updated. [ 1139.933544] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.933801] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.933858] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.934225] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.934443] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.947132] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: IN_PROGRESS for 2s [ 1139.950026] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-105 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.950223] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.953031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.953031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.953031] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.953031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.953031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.953031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.953031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.953031] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.953790] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1139.953790] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1139.953790] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1139.953790] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.953790] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1139.953790] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1139.961474] env[69920]: INFO networking_nsxv3.common.synchronization [None req-a398fe88-23f3-4881-924d-27e0f8b0e763 None None] Enqueued Resource ID: 73c8d5e0-1e13-43e1-b79d-dcad47d6b77a with Priority: HIGHEST for action port [ 1139.962514] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73c8d5e0-1e13-43e1-b79d-dcad47d6b77a with Priority: HIGHEST for action port [ 1139.962813] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-73c8d5e0-1e13-43e1-b79d-dcad47d6b77a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.963334] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73c8d5e0-1e13-43e1-b79d-dcad47d6b77a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.963334] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73c8d5e0-1e13-43e1-b79d-dcad47d6b77a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.963334] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73c8d5e0-1e13-43e1-b79d-dcad47d6b77a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.963501] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73c8d5e0-1e13-43e1-b79d-dcad47d6b77a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.980399] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1139.980579] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1139.980945] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1139.981101] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.981444] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-4729724d-c9d9-4722-987c-93aac6459382 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.981624] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-4729724d-c9d9-4722-987c-93aac6459382" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.981751] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-4729724d-c9d9-4722-987c-93aac6459382" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.982204] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-4729724d-c9d9-4722-987c-93aac6459382" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.982376] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4729724d-c9d9-4722-987c-93aac6459382',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.067896] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aca15fc8-3d94-4e24-9796-2477465c9437 in Status: SUCCESS [ 1140.067896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.067896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.067896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.067896] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.067896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.067896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.067896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.067896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.067896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.067896] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aca15fc8-3d94-4e24-9796-2477465c9437',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.466455] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73c8d5e0-1e13-43e1-b79d-dcad47d6b77a [ 1140.466701] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.466826] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.468401] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.468401] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.468401] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.468401] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73c8d5e0-1e13-43e1-b79d-dcad47d6b77a already deleted. [ 1140.468401] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73c8d5e0-1e13-43e1-b79d-dcad47d6b77a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.486134] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.486804] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.487558] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.487968] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.488635] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.488635] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 4729724d-c9d9-4722-987c-93aac6459382 not found, creating... [ 1140.488836] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.489109] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.489275] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.490622] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.490622] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.490622] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.490622] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.491023] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.491023] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.491565] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.491565] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 4729724d-c9d9-4722-987c-93aac6459382 is going to be created. [ 1140.518225] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.518604] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.518736] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.519204] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.519438] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.519726] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-4729724d-c9d9-4722-987c-93aac6459382" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.573098] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-aca15fc8-3d94-4e24-9796-2477465c9437 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.573098] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.573098] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.573437] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.573724] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.573954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.574100] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.574392] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.574561] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.574863] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.575202] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-aca15fc8-3d94-4e24-9796-2477465c9437 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.575839] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.575839] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.575839] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.576715] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.576715] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.576715] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.576715] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.576983] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.576983] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.577177] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aca15fc8-3d94-4e24-9796-2477465c9437',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.082397] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aca15fc8-3d94-4e24-9796-2477465c9437: rpc.has_security_group_logging(os_id): False [ 1141.100576] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.104335] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.104380] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.104598] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.104695] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.104944] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.105087] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.105197] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.105416] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.105536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.105764] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.105890] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.105983] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.106343] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.106466] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.106694] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.106831] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.107484] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.107701] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.109256] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.109391] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aca15fc8-3d94-4e24-9796-2477465c9437 is going to be updated. [ 1141.180681] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.180916] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.181075] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.181433] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.181491] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.214093] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aca15fc8-3d94-4e24-9796-2477465c9437 in Status: IN_PROGRESS for 2s [ 1141.534152] env[69920]: INFO networking_nsxv3.common.synchronization [req-a6f206f4-aa50-4296-8ff1-5f42569b9d2d req-3f9a157f-b90a-4f84-844e-df7a7c1724c9 service nova] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_rules [ 1141.534348] env[69920]: INFO networking_nsxv3.common.synchronization [req-a6f206f4-aa50-4296-8ff1-5f42569b9d2d req-3f9a157f-b90a-4f84-844e-df7a7c1724c9 service nova] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 1141.534518] env[69920]: INFO networking_nsxv3.common.synchronization [req-a6f206f4-aa50-4296-8ff1-5f42569b9d2d req-3f9a157f-b90a-4f84-844e-df7a7c1724c9 service nova] Enqueued Resource ID: 4729724d-c9d9-4722-987c-93aac6459382 with Priority: HIGHEST for action port [ 1141.538363] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_rules [ 1141.538580] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 1141.538737] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4729724d-c9d9-4722-987c-93aac6459382 with Priority: HIGHEST for action port [ 1141.539907] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.540050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.540116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.540328] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.540419] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.541378] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.541469] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.541672] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-4729724d-c9d9-4722-987c-93aac6459382 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.541772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4729724d-c9d9-4722-987c-93aac6459382" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.541836] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4729724d-c9d9-4722-987c-93aac6459382" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.542015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4729724d-c9d9-4722-987c-93aac6459382" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.542154] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4729724d-c9d9-4722-987c-93aac6459382',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.958385] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: SUCCESS [ 1141.958588] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a deletion is rescheduled due to dependency. [ 1141.958635] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.958782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.959021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.959268] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.959418] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.959522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.959718] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.959827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.959975] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.046530] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.046777] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.046868] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4729724d-c9d9-4722-987c-93aac6459382 with status ACTIVE [ 1142.047168] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.047168] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.047168] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.047431] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.047481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.047670] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.047779] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.047847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.048116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.048215] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.048414] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.048517] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.048580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.048731] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.048806] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.048895] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4729724d-c9d9-4722-987c-93aac6459382 is going to be updated. [ 1142.071242] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.071434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.071527] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.071784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.071999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.072219] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4729724d-c9d9-4722-987c-93aac6459382" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.196691] env[69920]: INFO networking_nsxv3.common.synchronization [None req-1952caae-078c-43f8-8550-c2a5f75821e1 tempest-AttachInterfacesTestJSON-901858583 tempest-AttachInterfacesTestJSON-901858583-project-member] Enqueued Resource ID: 6706e233-99bc-4f71-accd-d13e8c487aed with Priority: HIGHEST for action security_group_rules [ 1142.197314] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6706e233-99bc-4f71-accd-d13e8c487aed with Priority: HIGHEST for action security_group_rules [ 1142.197826] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6706e233-99bc-4f71-accd-d13e8c487aed taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.197826] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.197826] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.199672] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.199672] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6706e233-99bc-4f71-accd-d13e8c487aed',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.348397] env[69920]: INFO networking_nsxv3.common.synchronization [None req-89713cb1-6d68-4706-9a63-2d8dabe699c0 tempest-AttachInterfacesTestJSON-901858583 tempest-AttachInterfacesTestJSON-901858583-project-member] Enqueued Resource ID: 6706e233-99bc-4f71-accd-d13e8c487aed with Priority: HIGHEST for action security_group_rules [ 1142.349027] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6706e233-99bc-4f71-accd-d13e8c487aed with Priority: HIGHEST for action security_group_rules [ 1142.349406] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6706e233-99bc-4f71-accd-d13e8c487aed taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.349563] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.462492] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.719758] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.719947] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.720125] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.720338] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.720462] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.720579] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6706e233-99bc-4f71-accd-d13e8c487aed already deleted. [ 1142.720717] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.720919] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.721139] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.721276] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6706e233-99bc-4f71-accd-d13e8c487aed',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.964757] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.115515] env[69920]: INFO networking_nsxv3.common.synchronization [None req-ae151c3d-72aa-4f7f-b3c5-f54c54132f1f None None] Enqueued Resource ID: 42b55df8-14e4-49a0-bbff-d41521b9d19b with Priority: HIGHEST for action port [ 1143.119126] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42b55df8-14e4-49a0-bbff-d41521b9d19b with Priority: HIGHEST for action port [ 1143.120009] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-42b55df8-14e4-49a0-bbff-d41521b9d19b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.120153] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42b55df8-14e4-49a0-bbff-d41521b9d19b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.120217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42b55df8-14e4-49a0-bbff-d41521b9d19b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.120499] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42b55df8-14e4-49a0-bbff-d41521b9d19b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.120581] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42b55df8-14e4-49a0-bbff-d41521b9d19b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.230794] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aca15fc8-3d94-4e24-9796-2477465c9437 in Status: SUCCESS [ 1143.231144] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.246738] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.248142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.248142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.248142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.248142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.248142] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6706e233-99bc-4f71-accd-d13e8c487aed already deleted. [ 1143.248142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.467128] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.467336] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.467506] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.467637] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.467719] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.467831] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be updated. [ 1143.504593] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.504781] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.504820] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.505132] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.505207] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.515179] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: IN_PROGRESS for 2s [ 1143.625865] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42b55df8-14e4-49a0-bbff-d41521b9d19b [ 1143.626250] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.626406] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.626491] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.628017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.628017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.628017] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42b55df8-14e4-49a0-bbff-d41521b9d19b already deleted. [ 1143.628017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42b55df8-14e4-49a0-bbff-d41521b9d19b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.710452] env[69920]: INFO networking_nsxv3.common.synchronization [None req-a9ecd015-8523-4834-8ca2-2f0b5d3e9902 tempest-ServerActionsTestJSON-2022006223 tempest-ServerActionsTestJSON-2022006223-project-member] Enqueued Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_rules [ 1144.710452] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_rules [ 1144.711009] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.711009] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.711009] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.711548] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.711548] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.814345] env[69920]: INFO networking_nsxv3.common.synchronization [None req-08353293-382f-4cae-b037-c6d1ae927981 tempest-ServerActionsTestJSON-2022006223 tempest-ServerActionsTestJSON-2022006223-project-member] Enqueued Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_rules [ 1144.814961] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_rules [ 1144.815317] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.815424] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.233064] env[69920]: INFO networking_nsxv3.common.synchronization [None req-d8657ee6-044c-4876-bddb-b55a669f24a6 None None] Enqueued Resource ID: 9758b487-a6b0-434a-833f-2ee8a02d9a63 with Priority: HIGHEST for action port [ 1145.233599] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9758b487-a6b0-434a-833f-2ee8a02d9a63 with Priority: HIGHEST for action port [ 1145.233958] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-9758b487-a6b0-434a-833f-2ee8a02d9a63 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.234231] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9758b487-a6b0-434a-833f-2ee8a02d9a63" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.234312] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9758b487-a6b0-434a-833f-2ee8a02d9a63" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.234561] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9758b487-a6b0-434a-833f-2ee8a02d9a63" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.234661] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9758b487-a6b0-434a-833f-2ee8a02d9a63',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.239598] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.239753] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.240037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.240037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.240335] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.240335] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 already deleted. [ 1145.240335] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.241158] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.241158] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.241264] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.527027] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: SUCCESS [ 1145.527729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.528015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.528434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.528737] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.529338] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.529338] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.529475] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.529660] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.529856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.530228] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.738871] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9758b487-a6b0-434a-833f-2ee8a02d9a63 [ 1145.738871] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.739329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.739329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.739329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.739438] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.739473] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9758b487-a6b0-434a-833f-2ee8a02d9a63 already deleted. [ 1145.739538] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9758b487-a6b0-434a-833f-2ee8a02d9a63" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.765140] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.765140] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.765140] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.765140] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.765140] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.765140] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 already deleted. [ 1145.765140] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.033882] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.034122] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.034260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.034662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.034966] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.035280] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.035417] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.035743] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.035915] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.036516] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.036613] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.036741] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.036812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.037067] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.037303] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.037433] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.037502] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.037702] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.037821] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.037938] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.038055] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.540667] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fdaff9b-63be-497c-8622-3160e739856a: rpc.has_security_group_logging(os_id): False [ 1146.564800] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.564972] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.565033] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.565291] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.565414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.565580] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.565679] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.565735] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.565908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.565977] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.566425] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.566576] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.566649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.566814] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.566891] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.567226] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.567380] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.567465] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.567645] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.567757] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.567888] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be updated. [ 1146.638315] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.638506] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.638563] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.638769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.638919] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.654373] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: IN_PROGRESS for 2s [ 1147.834408] env[69920]: INFO networking_nsxv3.common.synchronization [req-8215163e-f30c-4c36-9d64-cc148431c74d req-4424e7e0-7441-40ad-a145-53ee82cf575f tempest-AttachVolumeShelveTestJSON-389172843 tempest-AttachVolumeShelveTestJSON-389172843-project-member] Enqueued Resource ID: fab6b45f-3ae6-4550-ba52-182144930713 with Priority: HIGHEST for action security_group_members [ 1147.835075] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab6b45f-3ae6-4550-ba52-182144930713 with Priority: HIGHEST for action security_group_members [ 1147.835334] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab6b45f-3ae6-4550-ba52-182144930713 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.835458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.835546] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.835784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.835941] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.836251] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.836320] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.837280] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.837280] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.837280] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab6b45f-3ae6-4550-ba52-182144930713',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.172833] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-436 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.173667] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-436" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.173667] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-436" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.173667] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-436" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.173802] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.173947] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.174084] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.174328] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.174519] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.174789] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1148.174916] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1148.175043] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1148.175169] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1148.175291] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1148.175416] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1148.175558] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1148.200160] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1148.200160] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1148.200160] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1148.200160] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-436" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.200160] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-d201dadc-ab89-4ede-8c29-41217e3af341 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.200160] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-d201dadc-ab89-4ede-8c29-41217e3af341" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.200160] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-d201dadc-ab89-4ede-8c29-41217e3af341" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.200160] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-d201dadc-ab89-4ede-8c29-41217e3af341" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.200541] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d201dadc-ab89-4ede-8c29-41217e3af341',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.339947] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.340126] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.340201] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.340419] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.340510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.340770] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.340882] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.340945] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.341143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.341207] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.341338] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab6b45f-3ae6-4550-ba52-182144930713 already deleted. [ 1148.341433] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.667710] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: SUCCESS [ 1148.667971] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.684746] env[69920]: INFO networking_nsxv3.common.synchronization [req-dce1e610-c31c-4304-8c43-051cce67357c req-56a177d9-1355-4e62-afe4-630caf537084 tempest-ServerDiskConfigTestJSON-714416826 tempest-ServerDiskConfigTestJSON-714416826-project-member] Enqueued Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 1148.685515] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 1148.685972] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.686195] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.686277] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.686546] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.687028] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.687028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.687028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.687207] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.687207] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.687350] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.702295] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.702514] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.702668] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.702950] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.703178] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.703307] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port d201dadc-ab89-4ede-8c29-41217e3af341 not found, creating... [ 1148.703578] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.703749] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.703895] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.704140] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.704286] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.704577] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.704741] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.704872] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.705102] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.705247] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.705393] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: d201dadc-ab89-4ede-8c29-41217e3af341 is going to be created. [ 1148.725706] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.726049] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.726178] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.727066] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.727443] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.727740] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-d201dadc-ab89-4ede-8c29-41217e3af341" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.189745] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.190153] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.190153] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.190261] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.190329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.190559] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.190655] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.190719] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.190887] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.190954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.191104] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 is going to be updated. [ 1149.224876] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.225065] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.225140] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.225318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.225462] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.235519] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: IN_PROGRESS for 2s [ 1149.436150] env[69920]: INFO networking_nsxv3.common.synchronization [req-8215163e-f30c-4c36-9d64-cc148431c74d req-b2a8b91d-4649-4519-8da7-10c3a1d8aa22 service nova] Enqueued Resource ID: fab6b45f-3ae6-4550-ba52-182144930713 with Priority: HIGHEST for action security_group_rules [ 1149.436234] env[69920]: INFO networking_nsxv3.common.synchronization [req-8215163e-f30c-4c36-9d64-cc148431c74d req-b2a8b91d-4649-4519-8da7-10c3a1d8aa22 service nova] Enqueued Resource ID: fab6b45f-3ae6-4550-ba52-182144930713 with Priority: HIGHEST for action security_group_members [ 1149.436369] env[69920]: INFO networking_nsxv3.common.synchronization [req-8215163e-f30c-4c36-9d64-cc148431c74d req-b2a8b91d-4649-4519-8da7-10c3a1d8aa22 service nova] Enqueued Resource ID: d201dadc-ab89-4ede-8c29-41217e3af341 with Priority: HIGHEST for action port [ 1149.436678] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab6b45f-3ae6-4550-ba52-182144930713 with Priority: HIGHEST for action security_group_rules [ 1149.436813] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab6b45f-3ae6-4550-ba52-182144930713 with Priority: HIGHEST for action security_group_members [ 1149.436910] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d201dadc-ab89-4ede-8c29-41217e3af341 with Priority: HIGHEST for action port [ 1149.437533] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fab6b45f-3ae6-4550-ba52-182144930713 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.437659] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.437753] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.438018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.438018] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fab6b45f-3ae6-4550-ba52-182144930713',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.439646] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab6b45f-3ae6-4550-ba52-182144930713 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.439646] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.440569] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.440569] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.440569] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.440569] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.440569] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.440569] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.440569] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.440569] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab6b45f-3ae6-4550-ba52-182144930713',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.441421] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-d201dadc-ab89-4ede-8c29-41217e3af341 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.441524] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d201dadc-ab89-4ede-8c29-41217e3af341" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.441595] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d201dadc-ab89-4ede-8c29-41217e3af341" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.441822] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d201dadc-ab89-4ede-8c29-41217e3af341" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.441902] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d201dadc-ab89-4ede-8c29-41217e3af341',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.944160] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab6b45f-3ae6-4550-ba52-182144930713 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.944287] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.944450] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fab6b45f-3ae6-4550-ba52-182144930713',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.945364] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d201dadc-ab89-4ede-8c29-41217e3af341 with status ACTIVE [ 1149.946020] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.946020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.946020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.946020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.946020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.946324] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.946324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.946324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.946605] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.946720] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.946939] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.947057] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.947146] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.947302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.947411] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.947508] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d201dadc-ab89-4ede-8c29-41217e3af341 is going to be updated. [ 1149.970396] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.970396] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.970396] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.970396] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.970396] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.970396] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d201dadc-ab89-4ede-8c29-41217e3af341" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.229358] env[69920]: INFO networking_nsxv3.common.synchronization [req-9fa9fc20-4534-4bd1-b786-05c2acb6f9db req-3d3c5445-6ee9-4b6b-a3ab-ffbe5a5a07c1 tempest-AttachInterfacesUnderV243Test-1114553105 tempest-AttachInterfacesUnderV243Test-1114553105-project-member] Enqueued Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGHEST for action security_group_members [ 1150.229853] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGHEST for action security_group_members [ 1150.230200] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-d81f2be6-2daa-4694-bfd3-496e64f467ac taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.230292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.230348] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.230600] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.230752] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.230851] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.230933] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.231244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.231371] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.231497] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.449564] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fab6b45f-3ae6-4550-ba52-182144930713',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.671221] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-245 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.672030] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-245" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.672271] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-245" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.672653] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-245" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.673290] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.673724] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.675209] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.675209] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.675209] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.675560] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1150.677413] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1150.677413] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1150.677413] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1150.677413] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1150.677413] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1150.677413] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1150.696563] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1150.696867] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1150.697076] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1150.697295] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-245" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.697777] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-c1c89675-9c86-4cf9-9c34-fdea74b6cf04 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.699139] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-c1c89675-9c86-4cf9-9c34-fdea74b6cf04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.699139] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-c1c89675-9c86-4cf9-9c34-fdea74b6cf04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.699139] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-c1c89675-9c86-4cf9-9c34-fdea74b6cf04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.699139] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1c89675-9c86-4cf9-9c34-fdea74b6cf04',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.735485] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.735485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.735485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.735485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.735485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.735485] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.735485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.735485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.735485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.735485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.735485] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d81f2be6-2daa-4694-bfd3-496e64f467ac already deleted. [ 1150.735485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.953931] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.955031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.955031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.955031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.955031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.955031] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab6b45f-3ae6-4550-ba52-182144930713 is going to be created. [ 1150.989339] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.989705] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.989705] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.989995] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.990425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.007705] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab6b45f-3ae6-4550-ba52-182144930713 in Status: UNINITIALIZED for 2s [ 1151.202073] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.202073] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.202073] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.202073] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.202434] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.202434] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port c1c89675-9c86-4cf9-9c34-fdea74b6cf04 not found, creating... [ 1151.202597] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.202856] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.202912] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.203179] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.203380] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.203756] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.203930] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.204088] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.204320] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.204464] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.204612] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: c1c89675-9c86-4cf9-9c34-fdea74b6cf04 is going to be created. [ 1151.244401] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.244815] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.244815] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.245046] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.245291] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.245538] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-c1c89675-9c86-4cf9-9c34-fdea74b6cf04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.248972] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: SUCCESS [ 1151.249201] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 deletion is rescheduled due to dependency. [ 1151.249288] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.987214] env[69920]: INFO networking_nsxv3.common.synchronization [req-9fa9fc20-4534-4bd1-b786-05c2acb6f9db req-03193463-30f8-4610-a9e5-eb1a23128584 service nova] Enqueued Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGHEST for action security_group_rules [ 1151.987416] env[69920]: INFO networking_nsxv3.common.synchronization [req-9fa9fc20-4534-4bd1-b786-05c2acb6f9db req-03193463-30f8-4610-a9e5-eb1a23128584 service nova] Enqueued Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGHEST for action security_group_members [ 1151.987560] env[69920]: INFO networking_nsxv3.common.synchronization [req-9fa9fc20-4534-4bd1-b786-05c2acb6f9db req-03193463-30f8-4610-a9e5-eb1a23128584 service nova] Enqueued Resource ID: c1c89675-9c86-4cf9-9c34-fdea74b6cf04 with Priority: HIGHEST for action port [ 1151.987799] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGHEST for action security_group_rules [ 1151.987933] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGHEST for action security_group_members [ 1151.988036] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1c89675-9c86-4cf9-9c34-fdea74b6cf04 with Priority: HIGHEST for action port [ 1151.988619] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d81f2be6-2daa-4694-bfd3-496e64f467ac taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.988750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.988821] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.989412] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.989558] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.990475] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-d81f2be6-2daa-4694-bfd3-496e64f467ac taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.990575] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.993747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.993747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.993747] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.993747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.993747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.993747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.993747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.993747] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.993747] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1c89675-9c86-4cf9-9c34-fdea74b6cf04 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.993747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1c89675-9c86-4cf9-9c34-fdea74b6cf04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.993747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1c89675-9c86-4cf9-9c34-fdea74b6cf04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.993747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1c89675-9c86-4cf9-9c34-fdea74b6cf04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.993747] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1c89675-9c86-4cf9-9c34-fdea74b6cf04',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.495160] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-d81f2be6-2daa-4694-bfd3-496e64f467ac taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.495658] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.496719] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.497665] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1c89675-9c86-4cf9-9c34-fdea74b6cf04 with status ACTIVE [ 1152.497868] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.497989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.498075] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.498319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.498414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.498591] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.498693] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.498756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.498920] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.498998] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.499235] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.499306] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.499364] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.500030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.500030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.500030] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1c89675-9c86-4cf9-9c34-fdea74b6cf04 is going to be updated. [ 1152.522606] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.522606] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.522606] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.522606] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.522606] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.522896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1c89675-9c86-4cf9-9c34-fdea74b6cf04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.002120] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.017454] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab6b45f-3ae6-4550-ba52-182144930713 in Status: SUCCESS [ 1153.017694] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.017849] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.018093] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.018310] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.018443] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.018510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.018676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.018759] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.018845] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.018935] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fab6b45f-3ae6-4550-ba52-182144930713',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.503745] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.504123] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.504123] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.504202] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.504237] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.504345] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d81f2be6-2daa-4694-bfd3-496e64f467ac is going to be created. [ 1153.520670] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fab6b45f-3ae6-4550-ba52-182144930713',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.532045] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.532045] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.532045] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.532045] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.532045] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.541312] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d81f2be6-2daa-4694-bfd3-496e64f467ac in Status: UNINITIALIZED for 2s [ 1154.023197] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fab6b45f-3ae6-4550-ba52-182144930713: rpc.has_security_group_logging(os_id): False [ 1154.047155] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.047384] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.047384] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.047538] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.047629] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.047876] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.047976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.048057] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.048433] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.048433] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.048433] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fab6b45f-3ae6-4550-ba52-182144930713 is going to be created. [ 1154.113037] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.113169] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.113397] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.113499] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.113641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.127700] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab6b45f-3ae6-4550-ba52-182144930713 in Status: IN_PROGRESS for 2s [ 1155.243111] env[69920]: INFO networking_nsxv3.common.synchronization [req-c7df8007-f7ff-4bb4-bc34-753af7ec13ca req-5786ca01-d17d-4284-9415-cbfc230dd3d9 tempest-AttachInterfacesTestJSON-901858583 tempest-AttachInterfacesTestJSON-901858583-project-member] Enqueued Resource ID: 6706e233-99bc-4f71-accd-d13e8c487aed with Priority: HIGHEST for action security_group_members [ 1155.243611] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6706e233-99bc-4f71-accd-d13e8c487aed with Priority: HIGHEST for action security_group_members [ 1155.243822] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6706e233-99bc-4f71-accd-d13e8c487aed taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.243974] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.244088] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.244883] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.253798] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.253945] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.254036] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.254266] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.254361] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.254471] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6706e233-99bc-4f71-accd-d13e8c487aed',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.414813] env[69920]: INFO networking_nsxv3.common.synchronization [req-03f93578-8fce-4835-a77c-b849a84f0efe req-f2d4c863-ad76-412e-b853-6337c0b4109d tempest-DeleteServersTestJSON-1690074738 tempest-DeleteServersTestJSON-1690074738-project-member] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 1155.414813] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 1155.414813] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.414813] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.414813] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.414813] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.414813] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.414813] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.414813] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.414813] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.415521] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.415521] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.553660] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d81f2be6-2daa-4694-bfd3-496e64f467ac in Status: SUCCESS [ 1155.556044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.556044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.556044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.556044] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.556044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.556044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.556044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.556044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.556044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.556044] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.643020] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.643237] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.643353] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.643627] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.643881] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.644052] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.644176] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.644490] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.644551] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.644919] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1155.645110] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1155.645239] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1155.645361] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1155.645485] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1155.645601] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1155.645744] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1155.692463] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1155.692463] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.046 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1155.692463] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1155.692463] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.692463] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-b92f830b-5eef-4260-a56b-94af4a4ec679 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.692790] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-b92f830b-5eef-4260-a56b-94af4a4ec679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.692790] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-b92f830b-5eef-4260-a56b-94af4a4ec679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.693184] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-b92f830b-5eef-4260-a56b-94af4a4ec679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.693347] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b92f830b-5eef-4260-a56b-94af4a4ec679',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.757515] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.757678] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.757751] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.758084] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.758277] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.758514] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.758667] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.758755] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.758952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.759069] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.759243] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6706e233-99bc-4f71-accd-d13e8c487aed already deleted. [ 1155.759333] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.917490] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.917664] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.917725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.917937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.918042] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.918292] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.918419] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.918474] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.918632] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.918711] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.918800] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be updated. [ 1155.945905] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.946073] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.946128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.946339] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.946481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.960188] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: IN_PROGRESS for 2s [ 1156.058563] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.140936] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab6b45f-3ae6-4550-ba52-182144930713 in Status: SUCCESS [ 1156.141200] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.195564] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.195804] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.195938] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.196251] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.196411] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.196572] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port b92f830b-5eef-4260-a56b-94af4a4ec679 not found, creating... [ 1156.196854] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.197855] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.197855] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.197855] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.197855] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.197855] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.198192] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.198192] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.198327] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.198493] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.198676] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: b92f830b-5eef-4260-a56b-94af4a4ec679 is going to be created. [ 1156.223713] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.223932] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.224096] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.224370] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.224615] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.225033] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-b92f830b-5eef-4260-a56b-94af4a4ec679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.560753] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d81f2be6-2daa-4694-bfd3-496e64f467ac: rpc.has_security_group_logging(os_id): False [ 1156.580522] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.580522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.580522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.580522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.580522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.580522] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.580522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.580522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.580522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.580522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.580522] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d81f2be6-2daa-4694-bfd3-496e64f467ac is going to be created. [ 1156.644681] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.644681] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.644681] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.644681] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.644933] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.659867] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d81f2be6-2daa-4694-bfd3-496e64f467ac in Status: IN_PROGRESS for 2s [ 1156.916072] env[69920]: INFO networking_nsxv3.common.synchronization [req-c7df8007-f7ff-4bb4-bc34-753af7ec13ca req-fe1fa3f0-b193-44fa-a9e3-0786ad7f6ed5 service nova] Enqueued Resource ID: 6706e233-99bc-4f71-accd-d13e8c487aed with Priority: HIGHEST for action security_group_rules [ 1156.916274] env[69920]: INFO networking_nsxv3.common.synchronization [req-c7df8007-f7ff-4bb4-bc34-753af7ec13ca req-fe1fa3f0-b193-44fa-a9e3-0786ad7f6ed5 service nova] Enqueued Resource ID: 6706e233-99bc-4f71-accd-d13e8c487aed with Priority: HIGHEST for action security_group_members [ 1156.916409] env[69920]: INFO networking_nsxv3.common.synchronization [req-c7df8007-f7ff-4bb4-bc34-753af7ec13ca req-fe1fa3f0-b193-44fa-a9e3-0786ad7f6ed5 service nova] Enqueued Resource ID: b92f830b-5eef-4260-a56b-94af4a4ec679 with Priority: HIGHEST for action port [ 1156.916978] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6706e233-99bc-4f71-accd-d13e8c487aed with Priority: HIGHEST for action security_group_rules [ 1156.918037] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6706e233-99bc-4f71-accd-d13e8c487aed with Priority: HIGHEST for action security_group_members [ 1156.918885] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b92f830b-5eef-4260-a56b-94af4a4ec679 with Priority: HIGHEST for action port [ 1156.918885] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6706e233-99bc-4f71-accd-d13e8c487aed taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.918885] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.918885] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.919146] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.919146] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6706e233-99bc-4f71-accd-d13e8c487aed',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.920485] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6706e233-99bc-4f71-accd-d13e8c487aed taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.920485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.920485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.920655] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.920690] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.923486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.923486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.923486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.923486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.923486] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6706e233-99bc-4f71-accd-d13e8c487aed',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.923486] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-b92f830b-5eef-4260-a56b-94af4a4ec679 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.923486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b92f830b-5eef-4260-a56b-94af4a4ec679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.923486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b92f830b-5eef-4260-a56b-94af4a4ec679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.923486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b92f830b-5eef-4260-a56b-94af4a4ec679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.923486] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b92f830b-5eef-4260-a56b-94af4a4ec679',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.394879] env[69920]: INFO networking_nsxv3.common.synchronization [req-ba321465-0cca-4e4f-a418-424b183c1a03 req-d93a7d9a-f477-486d-9142-52ef66424ac7 tempest-ServersTestJSON-738065696 tempest-ServersTestJSON-738065696-project-member] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1157.395641] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1157.396011] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.396159] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.396233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.396549] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.396780] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.397871] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.398166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.398166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.398318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.398436] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.424488] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6706e233-99bc-4f71-accd-d13e8c487aed taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.424488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.424817] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6706e233-99bc-4f71-accd-d13e8c487aed',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.425829] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b92f830b-5eef-4260-a56b-94af4a4ec679 with status ACTIVE [ 1157.426110] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.426324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.426393] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.426603] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.426697] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.426884] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.426983] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.427857] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.427857] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.428001] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.428379] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.428513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.428617] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.428825] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.428915] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.429033] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b92f830b-5eef-4260-a56b-94af4a4ec679 is going to be updated. [ 1157.460410] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.461132] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.461132] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.461307] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.461898] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.462556] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b92f830b-5eef-4260-a56b-94af4a4ec679" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.769199] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-21 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.769608] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.769608] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.769806] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.770344] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.770599] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.770725] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.771015] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.771198] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.771416] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1157.771537] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1157.771654] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1157.771766] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1157.771879] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1157.771989] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1157.772190] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1157.792036] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1157.792230] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1157.792371] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1157.792681] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.792998] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-6252a6ad-27a0-47fd-8f00-60c71ed01985 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.793189] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-6252a6ad-27a0-47fd-8f00-60c71ed01985" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.793316] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-6252a6ad-27a0-47fd-8f00-60c71ed01985" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.793659] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-6252a6ad-27a0-47fd-8f00-60c71ed01985" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.793809] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6252a6ad-27a0-47fd-8f00-60c71ed01985',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.902056] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.931098] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6706e233-99bc-4f71-accd-d13e8c487aed',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.973498] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: SUCCESS [ 1157.973686] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a deletion is rescheduled due to dependency. [ 1157.973803] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.991173] env[69920]: INFO networking_nsxv3.common.synchronization [req-d6b02302-b3cf-4791-9d61-64eba5a43eac req-3d67215d-afdb-458f-937d-cc321bada11b tempest-ServersWithSpecificFlavorTestJSON-1780415271 tempest-ServersWithSpecificFlavorTestJSON-1780415271-project-member] Enqueued Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGHEST for action security_group_members [ 1157.991693] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGHEST for action security_group_members [ 1157.991986] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-81b4d229-34c1-420c-acac-a5e9d44d33e5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.992115] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.992180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.992379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.992547] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.992643] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.992702] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.992852] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.992934] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.993343] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81b4d229-34c1-420c-acac-a5e9d44d33e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.296363] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.296675] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.297936] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.298317] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.298528] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.299322] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 6252a6ad-27a0-47fd-8f00-60c71ed01985 not found, creating... [ 1158.299322] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.299322] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.299322] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.299556] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.299676] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.299979] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.301441] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.301576] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.301824] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.301968] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.302140] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 6252a6ad-27a0-47fd-8f00-60c71ed01985 is going to be created. [ 1158.328727] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.328727] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.328727] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.329015] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.329248] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.329484] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-6252a6ad-27a0-47fd-8f00-60c71ed01985" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.404450] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.433334] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.433500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.433548] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.433757] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.433849] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.433943] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6706e233-99bc-4f71-accd-d13e8c487aed is going to be created. [ 1158.474766] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.474987] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.475106] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.475342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.475510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.488442] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6706e233-99bc-4f71-accd-d13e8c487aed in Status: UNINITIALIZED for 2s [ 1158.496096] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.496376] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.496376] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.496577] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.496707] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.496909] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.497047] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.497115] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.497265] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.497348] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.497427] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 is going to be updated. [ 1158.543473] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.543714] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.543775] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.544052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.544270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.561920] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 in Status: IN_PROGRESS for 2s [ 1158.672498] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d81f2be6-2daa-4694-bfd3-496e64f467ac in Status: SUCCESS [ 1158.672820] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.907036] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.907036] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.907036] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.908493] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.908493] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.908493] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1158.940843] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.940995] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.941093] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.941523] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.941680] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.951860] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1159.075627] env[69920]: INFO networking_nsxv3.common.synchronization [req-ba321465-0cca-4e4f-a418-424b183c1a03 req-af873fd2-3ed5-4a4e-8996-a93140eedfe6 service nova] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_rules [ 1159.075810] env[69920]: INFO networking_nsxv3.common.synchronization [req-ba321465-0cca-4e4f-a418-424b183c1a03 req-af873fd2-3ed5-4a4e-8996-a93140eedfe6 service nova] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1159.075975] env[69920]: INFO networking_nsxv3.common.synchronization [req-ba321465-0cca-4e4f-a418-424b183c1a03 req-af873fd2-3ed5-4a4e-8996-a93140eedfe6 service nova] Enqueued Resource ID: 6252a6ad-27a0-47fd-8f00-60c71ed01985 with Priority: HIGHEST for action port [ 1159.076274] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_rules [ 1159.077099] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1159.077099] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6252a6ad-27a0-47fd-8f00-60c71ed01985 with Priority: HIGHEST for action port [ 1159.077649] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.077855] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.077987] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.078332] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.078466] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.079487] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.080532] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.080532] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-6252a6ad-27a0-47fd-8f00-60c71ed01985 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.080532] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6252a6ad-27a0-47fd-8f00-60c71ed01985" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.080532] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6252a6ad-27a0-47fd-8f00-60c71ed01985" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.080532] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6252a6ad-27a0-47fd-8f00-60c71ed01985" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.080532] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6252a6ad-27a0-47fd-8f00-60c71ed01985',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.585481] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.585481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.590032] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6252a6ad-27a0-47fd-8f00-60c71ed01985 with status ACTIVE [ 1159.590032] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.590032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.590032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.590032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.590032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.590032] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.590032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.590032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.590032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.590032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.590032] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.590032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.590032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.590032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.590032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.590032] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6252a6ad-27a0-47fd-8f00-60c71ed01985 is going to be updated. [ 1159.614301] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.614301] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.614301] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.614301] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.614301] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.614301] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6252a6ad-27a0-47fd-8f00-60c71ed01985" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.501124] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6706e233-99bc-4f71-accd-d13e8c487aed in Status: SUCCESS [ 1160.501124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.501124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.501124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.501124] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.501124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.501124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.501124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.501124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.501124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.501124] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6706e233-99bc-4f71-accd-d13e8c487aed',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.555544] env[69920]: INFO networking_nsxv3.common.synchronization [req-c4ea1f78-ef1d-4239-aac5-36f58c607499 req-b53592a1-0b2a-4b52-b278-2ff6f6f7a614 tempest-ServerActionsTestJSON-2022006223 tempest-ServerActionsTestJSON-2022006223-project-member] Enqueued Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_members [ 1160.555544] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_members [ 1160.557069] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f35bb388-1251-4b12-b65e-3b2d1b58dda5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.557069] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.557069] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.558455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.558455] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.558455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.558455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.558455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.558455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.558455] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.574607] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 in Status: SUCCESS [ 1160.574786] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 deletion is rescheduled due to dependency. [ 1160.574904] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.962490] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1160.962665] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.962867] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.963165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.963363] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.963499] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.963572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.963740] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.963827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.963926] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.009433] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6706e233-99bc-4f71-accd-d13e8c487aed',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.060813] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.061062] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.061062] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.061343] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.063063] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.063063] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.063063] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.063063] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.063063] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.063063] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.063063] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 already deleted. [ 1161.063063] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.167573] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-373 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.168425] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-373" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.168425] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-373" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.168644] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-373" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.169071] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.169367] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.169572] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.169916] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.170171] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.170489] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1161.170681] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1161.170868] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1161.171061] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1161.171484] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1161.171484] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1161.171703] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1161.193311] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1161.193564] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1161.193854] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1161.193954] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-373" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.194389] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-47e9852f-a4d7-4ffd-b9aa-6335c2aa2c07 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.194626] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-47e9852f-a4d7-4ffd-b9aa-6335c2aa2c07" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.194787] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-47e9852f-a4d7-4ffd-b9aa-6335c2aa2c07" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.195152] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-47e9852f-a4d7-4ffd-b9aa-6335c2aa2c07" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.195348] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47e9852f-a4d7-4ffd-b9aa-6335c2aa2c07',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.466120] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.515775] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6706e233-99bc-4f71-accd-d13e8c487aed: rpc.has_security_group_logging(os_id): False [ 1161.534243] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.534413] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.534461] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.534677] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.534767] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.535016] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.535121] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.535184] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.535340] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.535417] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.535508] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6706e233-99bc-4f71-accd-d13e8c487aed is going to be created. [ 1161.600825] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.600971] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.601051] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.601261] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.601437] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.612502] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6706e233-99bc-4f71-accd-d13e8c487aed in Status: IN_PROGRESS for 2s [ 1161.698635] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.698921] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.699088] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.699460] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.699642] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.699821] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 47e9852f-a4d7-4ffd-b9aa-6335c2aa2c07 not found, creating... [ 1161.700125] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.700293] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.700452] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.700697] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.700842] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.702236] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.702456] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.702589] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.702831] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.703015] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.703151] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 47e9852f-a4d7-4ffd-b9aa-6335c2aa2c07 is going to be created. [ 1161.725113] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.725113] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.725376] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.726794] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.727107] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.727398] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-47e9852f-a4d7-4ffd-b9aa-6335c2aa2c07" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.924970] env[69920]: INFO networking_nsxv3.common.synchronization [req-43c26a9e-b36d-4664-9ff1-502a2db23643 req-e216cee1-6fe2-4cc1-99f7-c8d98892348b tempest-ServerActionsTestOtherB-54229569 tempest-ServerActionsTestOtherB-54229569-project-member] Enqueued Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_members [ 1161.926031] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_members [ 1161.926031] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.926031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.927533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.930027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.930027] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.930027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.930027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.930027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.930027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.930027] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.968558] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.427684] env[69920]: INFO networking_nsxv3.common.synchronization [req-d3ddb4a1-c821-4aac-98e2-c6393aa6eed9 req-0bdae45c-7c1d-437d-a99d-a21e2595f53c tempest-ServerDiskConfigTestJSON-714416826 tempest-ServerDiskConfigTestJSON-714416826-project-member] Enqueued Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 1162.428227] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 1162.428616] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.428722] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.428813] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.429367] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.429604] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.429755] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.429865] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.430096] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.430234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.430540] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.432660] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.432829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.432929] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.433215] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.433352] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.433586] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.433742] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.433847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.434252] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.434403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.434534] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b is going to be updated. [ 1162.461653] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.461947] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.462025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.462273] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.462422] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.472135] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: IN_PROGRESS for 2s [ 1162.472135] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.472135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.472135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.472358] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.472443] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.472526] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1162.502248] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.503096] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.503192] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.503489] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.503841] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.514886] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1162.766902] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-538 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.767195] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-538" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.767238] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-538" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.770021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-538" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.770021] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.770021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.770021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.770021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.770021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.770021] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1162.770021] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1162.770021] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1162.770021] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1162.770021] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1162.770021] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1162.770021] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1162.772247] env[69920]: INFO networking_nsxv3.common.synchronization [req-c4ea1f78-ef1d-4239-aac5-36f58c607499 req-598c5ae5-4f06-4405-a844-de91edc89228 service nova] Enqueued Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_rules [ 1162.772417] env[69920]: INFO networking_nsxv3.common.synchronization [req-c4ea1f78-ef1d-4239-aac5-36f58c607499 req-598c5ae5-4f06-4405-a844-de91edc89228 service nova] Enqueued Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_members [ 1162.772587] env[69920]: INFO networking_nsxv3.common.synchronization [req-c4ea1f78-ef1d-4239-aac5-36f58c607499 req-598c5ae5-4f06-4405-a844-de91edc89228 service nova] Enqueued Resource ID: 47e9852f-a4d7-4ffd-b9aa-6335c2aa2c07 with Priority: HIGHEST for action port [ 1162.773189] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_rules [ 1162.773316] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_members [ 1162.773409] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47e9852f-a4d7-4ffd-b9aa-6335c2aa2c07 with Priority: HIGHEST for action port [ 1162.773905] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.774015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.774107] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.774235] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.774310] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.775118] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f35bb388-1251-4b12-b65e-3b2d1b58dda5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.775219] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.775283] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.775446] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.775587] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.775710] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.775755] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.775962] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.776105] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.776300] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.777385] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-47e9852f-a4d7-4ffd-b9aa-6335c2aa2c07 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.777385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47e9852f-a4d7-4ffd-b9aa-6335c2aa2c07" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.777385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47e9852f-a4d7-4ffd-b9aa-6335c2aa2c07" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.777614] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47e9852f-a4d7-4ffd-b9aa-6335c2aa2c07" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.777614] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47e9852f-a4d7-4ffd-b9aa-6335c2aa2c07',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.792109] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1162.792351] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1162.792506] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1162.792692] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-538" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.793077] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-f232a8db-809f-43b2-ae66-27047a39c8bf taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.793448] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-f232a8db-809f-43b2-ae66-27047a39c8bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.793600] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-f232a8db-809f-43b2-ae66-27047a39c8bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.793942] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-f232a8db-809f-43b2-ae66-27047a39c8bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.794273] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f232a8db-809f-43b2-ae66-27047a39c8bf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.936887] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.937169] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.937246] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.937507] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.937608] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.937803] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.937901] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.937964] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.938129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.938206] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.938292] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 is going to be updated. [ 1162.967388] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.967546] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.967617] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.967902] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.968065] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.977725] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: IN_PROGRESS for 2s [ 1163.279912] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.281007] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f35bb388-1251-4b12-b65e-3b2d1b58dda5 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.281127] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.281286] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47e9852f-a4d7-4ffd-b9aa-6335c2aa2c07 with status ACTIVE [ 1163.281443] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.281551] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.281614] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.281819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.281909] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.282084] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.282180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.282241] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.282390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.282467] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.282640] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.282732] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.282792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.282929] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.283012] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.283787] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47e9852f-a4d7-4ffd-b9aa-6335c2aa2c07 is going to be updated. [ 1163.297461] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.297811] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.298016] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.298393] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.298615] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.298828] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port f232a8db-809f-43b2-ae66-27047a39c8bf not found, creating... [ 1163.299162] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.299461] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.299647] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.299927] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.300141] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.300492] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.300752] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.300937] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.301217] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.301420] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.301615] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: f232a8db-809f-43b2-ae66-27047a39c8bf is going to be created. [ 1163.306136] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.306136] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.306136] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.306136] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.306136] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.306136] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47e9852f-a4d7-4ffd-b9aa-6335c2aa2c07" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.328056] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.328056] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.328056] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.328056] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.328056] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.328507] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-f232a8db-809f-43b2-ae66-27047a39c8bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.626596] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6706e233-99bc-4f71-accd-d13e8c487aed in Status: SUCCESS [ 1163.626596] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.787354] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.025165] env[69920]: INFO networking_nsxv3.common.synchronization [req-d3ddb4a1-c821-4aac-98e2-c6393aa6eed9 req-be99fe79-d500-4608-b135-43d0d6da90fb service nova] Enqueued Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_rules [ 1164.025165] env[69920]: INFO networking_nsxv3.common.synchronization [req-d3ddb4a1-c821-4aac-98e2-c6393aa6eed9 req-be99fe79-d500-4608-b135-43d0d6da90fb service nova] Enqueued Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 1164.025165] env[69920]: INFO networking_nsxv3.common.synchronization [req-d3ddb4a1-c821-4aac-98e2-c6393aa6eed9 req-be99fe79-d500-4608-b135-43d0d6da90fb service nova] Enqueued Resource ID: f232a8db-809f-43b2-ae66-27047a39c8bf with Priority: HIGHEST for action port [ 1164.025165] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_rules [ 1164.025165] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 1164.025165] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f232a8db-809f-43b2-ae66-27047a39c8bf with Priority: HIGHEST for action port [ 1164.025165] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.025165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.026310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.026639] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.026639] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.027913] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.028078] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.028425] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-f232a8db-809f-43b2-ae66-27047a39c8bf taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.028596] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f232a8db-809f-43b2-ae66-27047a39c8bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.028696] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f232a8db-809f-43b2-ae66-27047a39c8bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.028985] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f232a8db-809f-43b2-ae66-27047a39c8bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.029115] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f232a8db-809f-43b2-ae66-27047a39c8bf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.290463] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.290651] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.290966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.290966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.291122] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.291122] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 is going to be created. [ 1164.319831] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.319831] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.319831] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.320063] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.320176] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.336275] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: UNINITIALIZED for 2s [ 1164.488131] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: SUCCESS [ 1164.488131] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b deletion is rescheduled due to dependency. [ 1164.488131] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.525567] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1164.525567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.525567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.525567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.525567] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.525567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.525567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.525866] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.525866] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.525866] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.525943] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.531586] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.531703] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.533287] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f232a8db-809f-43b2-ae66-27047a39c8bf with status ACTIVE [ 1164.534793] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.534793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.534793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.534793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.534793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.534793] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.534793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.534793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.534793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.535124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.535124] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.535242] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.535242] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.535458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.535458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.535536] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f232a8db-809f-43b2-ae66-27047a39c8bf is going to be updated. [ 1164.559466] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.559647] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.559801] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.559946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.560099] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.560261] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f232a8db-809f-43b2-ae66-27047a39c8bf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.987707] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: SUCCESS [ 1164.988084] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 deletion is rescheduled due to dependency. [ 1164.988084] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.988264] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.988619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.988821] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.988972] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.989054] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.989274] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.989510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.989629] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.028426] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.028591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.028666] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.028909] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.029088] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.029218] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.029253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.029397] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.029481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.029586] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.029731] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.029826] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.029887] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.030053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.030251] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.030357] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.030420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.030565] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.030644] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.030725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.030832] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.492180] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.533203] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd313130-fb41-4c30-96a8-0facc1385d33: rpc.has_security_group_logging(os_id): False [ 1165.552519] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.552694] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.552765] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.552955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.553063] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.553256] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.553357] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.553418] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.553575] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.553654] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.554252] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.554252] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.554252] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.554252] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.554252] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.554437] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.554482] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.554532] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.554663] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.554737] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.554822] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1165.626585] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.626757] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.626826] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.627087] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.627296] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.642044] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1165.996763] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.347914] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: SUCCESS [ 1166.348200] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.348332] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.348591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.348782] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.348900] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.348964] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.349138] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.349232] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.349302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.349393] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.499942] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.500195] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.500308] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.500623] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.501091] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.501091] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 is going to be updated. [ 1166.535987] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.536142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.536224] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.536458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.536626] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.549033] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: IN_PROGRESS for 2s [ 1166.853288] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.355172] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f35bb388-1251-4b12-b65e-3b2d1b58dda5: rpc.has_security_group_logging(os_id): False [ 1167.376249] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.376249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.376515] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.380049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.380049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.380049] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.380049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.380049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.380049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.380049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.380049] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 is going to be created. [ 1167.464499] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.464669] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.464758] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.465044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.465909] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.484426] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: IN_PROGRESS for 2s [ 1167.659580] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1167.659580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.559673] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: SUCCESS [ 1168.559986] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.559986] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.560189] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.560383] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.560503] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.560569] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.560732] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.560814] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.560900] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.560988] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.023929] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1169.024106] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1169.063797] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.065043] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.065043] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.065043] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.065231] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.065382] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.065456] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.065731] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.065910] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.066127] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.066522] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.066693] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.066822] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.067113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.067404] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.067583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.067713] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.067986] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.068171] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.068335] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.068571] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.497553] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: SUCCESS [ 1169.497929] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.570829] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7eba410e-a0d6-4873-9363-054f457d21d4: rpc.has_security_group_logging(os_id): False [ 1169.589996] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.590210] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.590273] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.590450] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.590536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.590766] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.590868] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.590933] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.591127] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.591214] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.591356] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.591451] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.591506] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.591654] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.591743] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.592058] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.592058] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.592058] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.592287] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.592287] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.592468] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 is going to be updated. [ 1169.667385] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.667614] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.667614] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.667777] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.667891] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.680011] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: IN_PROGRESS for 2s [ 1170.867465] env[69920]: INFO networking_nsxv3.common.synchronization [req-392a721d-ddfa-493a-b240-ba889dd0466f req-70da1eb0-0fbc-44b2-998e-cee6af958c4f tempest-ServersTestJSON-738065696 tempest-ServersTestJSON-738065696-project-member] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1170.868015] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1170.868323] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.868459] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.868643] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.868746] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.868882] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.869076] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.869120] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.870059] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.870059] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.870059] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.373538] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.525717] env[69920]: INFO networking_nsxv3.common.synchronization [None req-6c47ba2e-6d0f-4d39-b59d-b676154804d6 tempest-ServerRescueNegativeTestJSON-1943285071 tempest-ServerRescueNegativeTestJSON-1943285071-project-member] Enqueued Resource ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 with Priority: HIGHEST for action security_group_rules [ 1171.526082] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 with Priority: HIGHEST for action security_group_rules [ 1171.526946] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21b36777-ea5b-4b29-980a-dc95fc42eb85 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.526946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.526946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.526946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.526946] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21b36777-ea5b-4b29-980a-dc95fc42eb85',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.668224] env[69920]: INFO networking_nsxv3.common.synchronization [None req-daa32642-322e-4191-9a66-7ed54ac3fde8 tempest-ServerRescueNegativeTestJSON-1943285071 tempest-ServerRescueNegativeTestJSON-1943285071-project-member] Enqueued Resource ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 with Priority: HIGHEST for action security_group_rules [ 1171.668563] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 with Priority: HIGHEST for action security_group_rules [ 1171.669621] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21b36777-ea5b-4b29-980a-dc95fc42eb85 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.669892] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.699888] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: SUCCESS [ 1171.703024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.881612] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.052924] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.052924] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.053206] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.053245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.053354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.053451] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 already deleted. [ 1172.053552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.053726] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.053915] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.054028] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21b36777-ea5b-4b29-980a-dc95fc42eb85',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.367116] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-272 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.367418] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-272" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.367523] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-272" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.367893] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-272" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.368097] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.368310] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.368395] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.368667] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.369303] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.369303] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1172.369303] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1172.369303] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1172.369462] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1172.369560] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1172.369640] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1172.369774] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1172.385329] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.385329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.385329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.385329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.385329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.385329] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1172.393072] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1172.393277] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1172.393430] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1172.393600] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-272" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.393919] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-eb2105ba-0276-4bc6-a2af-933090d4cdcd taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.394104] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-eb2105ba-0276-4bc6-a2af-933090d4cdcd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.394232] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-eb2105ba-0276-4bc6-a2af-933090d4cdcd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.394499] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-eb2105ba-0276-4bc6-a2af-933090d4cdcd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.394647] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb2105ba-0276-4bc6-a2af-933090d4cdcd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.476580] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.476885] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.476885] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.477141] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.477955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.488034] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1172.583790] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.583989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.583989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.584241] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.584335] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.584432] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 already deleted. [ 1172.584516] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.902304] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.902578] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.902616] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.902909] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.903082] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.903919] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.903919] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.903919] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.904130] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.904170] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.904471] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.904638] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.905336] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.905336] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.905336] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.905336] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: eb2105ba-0276-4bc6-a2af-933090d4cdcd is going to be updated. [ 1172.928351] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.928803] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.928803] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.929109] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.929838] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.929838] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-eb2105ba-0276-4bc6-a2af-933090d4cdcd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.883540] env[69920]: INFO networking_nsxv3.common.synchronization [req-f483cd9b-1884-4b26-8ae2-145d7dd59472 req-5c86d945-5dfc-45bb-837d-436e7304bd36 service nova] Enqueued Resource ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 with Priority: HIGHEST for action security_group_rules [ 1173.883744] env[69920]: INFO networking_nsxv3.common.synchronization [req-f483cd9b-1884-4b26-8ae2-145d7dd59472 req-5c86d945-5dfc-45bb-837d-436e7304bd36 service nova] Enqueued Resource ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 with Priority: HIGHEST for action security_group_members [ 1173.883969] env[69920]: INFO networking_nsxv3.common.synchronization [req-f483cd9b-1884-4b26-8ae2-145d7dd59472 req-5c86d945-5dfc-45bb-837d-436e7304bd36 service nova] Enqueued Resource ID: eb2105ba-0276-4bc6-a2af-933090d4cdcd with Priority: HIGHEST for action port [ 1173.884534] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 with Priority: HIGHEST for action security_group_rules [ 1173.884678] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 with Priority: HIGHEST for action security_group_members [ 1173.884776] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb2105ba-0276-4bc6-a2af-933090d4cdcd with Priority: HIGHEST for action port [ 1173.885304] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff50f1ab-6b6a-400e-a79f-0d29ae875687 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.885463] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.885537] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.885775] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.885867] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.887380] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff50f1ab-6b6a-400e-a79f-0d29ae875687 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.887620] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.887703] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.888028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.888186] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.888284] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.888336] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.888579] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.888660] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.888770] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.890680] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb2105ba-0276-4bc6-a2af-933090d4cdcd taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.891342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb2105ba-0276-4bc6-a2af-933090d4cdcd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.891487] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb2105ba-0276-4bc6-a2af-933090d4cdcd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.891674] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb2105ba-0276-4bc6-a2af-933090d4cdcd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.891790] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb2105ba-0276-4bc6-a2af-933090d4cdcd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.388531] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff50f1ab-6b6a-400e-a79f-0d29ae875687 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.388896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.391126] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.397801] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb2105ba-0276-4bc6-a2af-933090d4cdcd with status ACTIVE [ 1174.398314] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.398759] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.398849] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.399496] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.400269] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.401173] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.401173] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.401173] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.401173] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.401173] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.401813] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.402021] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.402135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.402318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.402503] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.402756] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb2105ba-0276-4bc6-a2af-933090d4cdcd is going to be updated. [ 1174.432353] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.432353] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.432565] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.432642] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.433400] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.433400] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb2105ba-0276-4bc6-a2af-933090d4cdcd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.503351] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1174.503609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.895015] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.265315] env[69920]: INFO networking_nsxv3.common.synchronization [req-e539d65d-0cc0-4e95-b6e7-94e327e1dbd7 req-991c5c39-8bc1-418a-8d66-951299ecd30d tempest-ServerActionsV293TestJSON-1763504731 tempest-ServerActionsV293TestJSON-1763504731-project-member] Enqueued Resource ID: bc15688a-089f-4071-9a2b-93e87f28f846 with Priority: HIGHEST for action security_group_members [ 1175.265897] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc15688a-089f-4071-9a2b-93e87f28f846 with Priority: HIGHEST for action security_group_members [ 1175.269867] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc15688a-089f-4071-9a2b-93e87f28f846 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.270022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.270081] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.270310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.270501] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.270699] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.270699] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.270821] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.270912] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.271021] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc15688a-089f-4071-9a2b-93e87f28f846',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.398854] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.399272] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.399272] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.399387] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.399430] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.399571] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 is going to be updated. [ 1175.440041] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.440041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.440041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.440041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.440041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.446942] env[69920]: INFO networking_nsxv3.common.synchronization [req-1ae0c731-1f49-4f43-bc8b-8b68519e4dff req-848c2e2b-6d44-4013-a3bf-2afed7cffd82 tempest-AttachInterfacesTestJSON-901858583 tempest-AttachInterfacesTestJSON-901858583-project-member] Enqueued Resource ID: 6706e233-99bc-4f71-accd-d13e8c487aed with Priority: HIGHEST for action security_group_members [ 1175.447365] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6706e233-99bc-4f71-accd-d13e8c487aed with Priority: HIGHEST for action security_group_members [ 1175.447793] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6706e233-99bc-4f71-accd-d13e8c487aed taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.448131] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.448131] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.448404] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.449908] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.450407] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.450407] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.450407] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.450605] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.450858] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6706e233-99bc-4f71-accd-d13e8c487aed',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.453574] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 in Status: IN_PROGRESS for 2s [ 1175.773603] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.773772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.773885] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.774629] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.774629] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.774803] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.774803] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.774928] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.775264] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.775488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.775589] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc15688a-089f-4071-9a2b-93e87f28f846 is going to be updated. [ 1175.815199] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.815199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.815199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.815199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.815199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.817578] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.817773] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.817899] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.818205] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.818506] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.818660] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.818784] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.819024] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.819187] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.819388] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1175.819904] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1175.820064] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1175.820190] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1175.820340] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1175.820430] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1175.820572] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1175.831642] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc15688a-089f-4071-9a2b-93e87f28f846 in Status: IN_PROGRESS for 2s [ 1175.842528] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1175.842528] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1175.842528] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1175.842528] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.842528] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-a54251d6-cc17-4c26-95aa-a11a00c08e5e taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.842528] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-a54251d6-cc17-4c26-95aa-a11a00c08e5e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.842528] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-a54251d6-cc17-4c26-95aa-a11a00c08e5e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.842528] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-a54251d6-cc17-4c26-95aa-a11a00c08e5e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.842528] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a54251d6-cc17-4c26-95aa-a11a00c08e5e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.955888] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6706e233-99bc-4f71-accd-d13e8c487aed',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.344432] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.344760] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.344941] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.345287] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.345914] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.346134] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port a54251d6-cc17-4c26-95aa-a11a00c08e5e not found, creating... [ 1176.346787] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.347086] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.347310] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.347586] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.348114] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.348215] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.348372] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.348560] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.348814] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.348972] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.349134] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: a54251d6-cc17-4c26-95aa-a11a00c08e5e is going to be created. [ 1176.373910] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.374224] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.374435] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.374805] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.375130] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.375427] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-a54251d6-cc17-4c26-95aa-a11a00c08e5e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.457936] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6706e233-99bc-4f71-accd-d13e8c487aed',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.960964] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.962167] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.962271] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.962531] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.962655] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.962779] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6706e233-99bc-4f71-accd-d13e8c487aed is going to be updated. [ 1177.004804] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.007330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.007330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.007330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.007330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.016269] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6706e233-99bc-4f71-accd-d13e8c487aed in Status: IN_PROGRESS for 2s [ 1177.317220] env[69920]: INFO networking_nsxv3.common.synchronization [req-1ae0c731-1f49-4f43-bc8b-8b68519e4dff req-5de62825-66a6-40e7-a8a1-809503378e6e service nova] Enqueued Resource ID: 6706e233-99bc-4f71-accd-d13e8c487aed with Priority: HIGHEST for action security_group_rules [ 1177.317220] env[69920]: INFO networking_nsxv3.common.synchronization [req-1ae0c731-1f49-4f43-bc8b-8b68519e4dff req-5de62825-66a6-40e7-a8a1-809503378e6e service nova] Enqueued Resource ID: 6706e233-99bc-4f71-accd-d13e8c487aed with Priority: HIGHEST for action security_group_members [ 1177.317220] env[69920]: INFO networking_nsxv3.common.synchronization [req-1ae0c731-1f49-4f43-bc8b-8b68519e4dff req-5de62825-66a6-40e7-a8a1-809503378e6e service nova] Enqueued Resource ID: a54251d6-cc17-4c26-95aa-a11a00c08e5e with Priority: HIGHEST for action port [ 1177.317220] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6706e233-99bc-4f71-accd-d13e8c487aed with Priority: HIGHEST for action security_group_rules [ 1177.317220] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6706e233-99bc-4f71-accd-d13e8c487aed with Priority: HIGHEST for action security_group_members [ 1177.317220] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a54251d6-cc17-4c26-95aa-a11a00c08e5e with Priority: HIGHEST for action port [ 1177.317220] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6706e233-99bc-4f71-accd-d13e8c487aed taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.317220] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.317220] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.317220] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.317220] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6706e233-99bc-4f71-accd-d13e8c487aed',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.317220] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6706e233-99bc-4f71-accd-d13e8c487aed taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.318312] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.318312] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-a54251d6-cc17-4c26-95aa-a11a00c08e5e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.318312] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a54251d6-cc17-4c26-95aa-a11a00c08e5e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.318312] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a54251d6-cc17-4c26-95aa-a11a00c08e5e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.318312] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a54251d6-cc17-4c26-95aa-a11a00c08e5e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.318312] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a54251d6-cc17-4c26-95aa-a11a00c08e5e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.467379] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 in Status: SUCCESS [ 1177.467379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.467379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.467379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.467379] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.467379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.467379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.467379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.467379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.467379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.467379] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.630589] env[69920]: INFO networking_nsxv3.common.synchronization [req-c20b8e6a-4485-4d96-aae9-615e6ad034a4 req-4f28d320-220b-49ed-af58-c40779c3b044 tempest-ServerDiskConfigTestJSON-714416826 tempest-ServerDiskConfigTestJSON-714416826-project-member] Enqueued Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 1177.631699] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGHEST for action security_group_members [ 1177.631699] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.631699] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.631699] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.631849] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.631907] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.632014] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.633665] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.633665] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.633665] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.633844] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.735560] env[69920]: INFO networking_nsxv3.common.synchronization [req-8bec8f14-c0ff-49d6-ba70-6c90d4468776 req-1df4f1b5-e1c7-4481-80e5-8e0007fc55fb tempest-DeleteServersTestJSON-1690074738 tempest-DeleteServersTestJSON-1690074738-project-member] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 1177.736088] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 1177.736395] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.736534] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.736609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.736820] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.736977] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.737089] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.737151] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.737297] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.737382] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.737473] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.820645] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6706e233-99bc-4f71-accd-d13e8c487aed taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.820851] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.821081] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a54251d6-cc17-4c26-95aa-a11a00c08e5e with status ACTIVE [ 1177.821274] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.821385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.821452] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.822391] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.822391] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.822391] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.822391] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.822588] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.822845] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.822899] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.823567] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.823680] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.823932] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.824120] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.824204] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.824519] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a54251d6-cc17-4c26-95aa-a11a00c08e5e is going to be updated. [ 1177.844505] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc15688a-089f-4071-9a2b-93e87f28f846 in Status: SUCCESS [ 1177.844505] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc15688a-089f-4071-9a2b-93e87f28f846 deletion is rescheduled due to dependency. [ 1177.844505] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.848688] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.848829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.848897] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.849134] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.849273] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.849452] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a54251d6-cc17-4c26-95aa-a11a00c08e5e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.976025] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff50f1ab-6b6a-400e-a79f-0d29ae875687 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.976025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.976025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.976025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.976025] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.976025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.976025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.976025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.976025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.976025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.976025] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff50f1ab-6b6a-400e-a79f-0d29ae875687 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.976025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.976025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.976025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.976025] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.976025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.977768] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.977768] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.977768] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.977768] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.977768] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.136235] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.136426] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.136502] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.136758] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.136961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.137179] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.137266] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.137266] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.137416] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.137506] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.137621] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 is going to be updated. [ 1178.179550] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.179812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.179910] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.180150] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.180506] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.190432] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: IN_PROGRESS for 2s [ 1178.240302] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.240302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.240302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.240559] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.243236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.243236] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.243236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.243236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.243236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.243236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.243236] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be updated. [ 1178.292303] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.292468] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.292513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.292737] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.292883] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.302680] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: IN_PROGRESS for 2s [ 1178.362750] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-105 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.362988] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.363167] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.363546] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.363866] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.364088] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.364287] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.364600] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.364785] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.365086] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1178.365235] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1178.365353] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1178.366263] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1178.366492] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1178.366653] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1178.366816] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1178.397735] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1178.398313] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1178.398313] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1178.398313] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-105" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.398692] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-75ee960c-41d4-4858-8b1e-8198b77eb0d7 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.398903] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-75ee960c-41d4-4858-8b1e-8198b77eb0d7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.399122] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-75ee960c-41d4-4858-8b1e-8198b77eb0d7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.399414] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-75ee960c-41d4-4858-8b1e-8198b77eb0d7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.399603] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75ee960c-41d4-4858-8b1e-8198b77eb0d7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.484260] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ff50f1ab-6b6a-400e-a79f-0d29ae875687: rpc.has_security_group_logging(os_id): False [ 1178.503989] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.504234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.504520] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.504798] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.527219] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.527543] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.527681] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.527788] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.528047] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.528146] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.529354] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.529354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.529354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.529354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.529354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.529354] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.529354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.529354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.529662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.529662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.529720] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 is going to be updated. [ 1178.616773] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.616941] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.616987] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.617258] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.617591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.646573] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 in Status: IN_PROGRESS for 2s [ 1178.902330] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.904667] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.904667] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.904667] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.904667] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.904667] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 75ee960c-41d4-4858-8b1e-8198b77eb0d7 not found, creating... [ 1178.904667] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.904667] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.904667] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.904667] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.904667] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.905375] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.905375] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.905375] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.905375] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.905517] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.905615] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 75ee960c-41d4-4858-8b1e-8198b77eb0d7 is going to be created. [ 1178.927172] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.927413] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.927543] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.928284] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.928284] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.928438] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-75ee960c-41d4-4858-8b1e-8198b77eb0d7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.036078] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6706e233-99bc-4f71-accd-d13e8c487aed in Status: SUCCESS [ 1179.036885] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.036885] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.036885] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.037274] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.037274] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.037390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.038828] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.038828] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.038828] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6706e233-99bc-4f71-accd-d13e8c487aed',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.540345] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6706e233-99bc-4f71-accd-d13e8c487aed',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.657032] env[69920]: INFO networking_nsxv3.common.synchronization [req-8bec8f14-c0ff-49d6-ba70-6c90d4468776 req-8ac36553-1818-4b41-b640-c092ec7498f8 service nova] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_rules [ 1179.657032] env[69920]: INFO networking_nsxv3.common.synchronization [req-8bec8f14-c0ff-49d6-ba70-6c90d4468776 req-8ac36553-1818-4b41-b640-c092ec7498f8 service nova] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 1179.657032] env[69920]: INFO networking_nsxv3.common.synchronization [req-8bec8f14-c0ff-49d6-ba70-6c90d4468776 req-8ac36553-1818-4b41-b640-c092ec7498f8 service nova] Enqueued Resource ID: 75ee960c-41d4-4858-8b1e-8198b77eb0d7 with Priority: HIGHEST for action port [ 1179.657032] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_rules [ 1179.657032] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 1179.657032] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75ee960c-41d4-4858-8b1e-8198b77eb0d7 with Priority: HIGHEST for action port [ 1179.657777] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.658281] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.658281] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.658281] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.658281] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.659508] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.659508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.659508] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-75ee960c-41d4-4858-8b1e-8198b77eb0d7 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.659816] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75ee960c-41d4-4858-8b1e-8198b77eb0d7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.659816] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75ee960c-41d4-4858-8b1e-8198b77eb0d7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.659938] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75ee960c-41d4-4858-8b1e-8198b77eb0d7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.659938] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75ee960c-41d4-4858-8b1e-8198b77eb0d7',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.042209] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6706e233-99bc-4f71-accd-d13e8c487aed',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.110397] env[69920]: INFO networking_nsxv3.common.synchronization [req-99a75858-0c06-426a-bbfa-c9314904ce90 req-ecdabbc7-e110-4ea4-b64a-d4a272f56739 tempest-ServerActionsTestOtherB-54229569 tempest-ServerActionsTestOtherB-54229569-project-member] Enqueued Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_members [ 1180.111134] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_members [ 1180.111724] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.111724] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.111874] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.111975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.112200] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.112304] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.112374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.112526] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.112666] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.112769] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.161311] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.161440] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.161602] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75ee960c-41d4-4858-8b1e-8198b77eb0d7 with status ACTIVE [ 1180.161773] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.161883] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.161936] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.162181] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.162303] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.162500] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.162569] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.162613] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.162750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.162830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.163057] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.163108] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.163188] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.163354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.163502] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.163502] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75ee960c-41d4-4858-8b1e-8198b77eb0d7 is going to be updated. [ 1180.204194] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7eba410e-a0d6-4873-9363-054f457d21d4 in Status: SUCCESS [ 1180.204464] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 deletion is rescheduled due to dependency. [ 1180.204639] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.206682] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.206682] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.206682] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.206682] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.206682] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.210350] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75ee960c-41d4-4858-8b1e-8198b77eb0d7" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.315315] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: SUCCESS [ 1180.315477] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a deletion is rescheduled due to dependency. [ 1180.315582] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.315759] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.315991] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.316195] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.316316] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.316429] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.316594] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.316686] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.316785] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.537442] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.537665] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-690" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.537832] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-690" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.538098] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-690" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.538777] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.538777] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.538777] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.538969] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.539100] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.539325] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1180.539443] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1180.539559] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1180.539675] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1180.539792] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1180.539904] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1180.540057] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1180.544634] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.544941] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.544941] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.545044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.545123] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.545220] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6706e233-99bc-4f71-accd-d13e8c487aed is going to be updated. [ 1180.564955] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1180.565486] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1180.565661] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1180.565854] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-690" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.566390] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-3e85edce-fa8a-45d4-b109-5bdd98a06303 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.566929] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-3e85edce-fa8a-45d4-b109-5bdd98a06303" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.567172] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-3e85edce-fa8a-45d4-b109-5bdd98a06303" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.567683] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-3e85edce-fa8a-45d4-b109-5bdd98a06303" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.567848] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e85edce-fa8a-45d4-b109-5bdd98a06303',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.577563] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.578039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.580023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.580023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.580023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.590904] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6706e233-99bc-4f71-accd-d13e8c487aed in Status: IN_PROGRESS for 2s [ 1180.618150] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.618631] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.618727] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.618955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.619103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.619652] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.619788] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.619855] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.620080] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.620170] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.620343] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b is going to be updated. [ 1180.655035] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.655035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.655035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.655035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.655035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.666421] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: IN_PROGRESS for 2s [ 1180.671106] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 in Status: SUCCESS [ 1180.671106] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.819530] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.072562] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.072943] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.073222] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.073534] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.073702] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.074082] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 3e85edce-fa8a-45d4-b109-5bdd98a06303 not found, creating... [ 1181.074416] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.074593] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.075956] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.075956] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.075956] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.075956] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.075956] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.075956] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.075956] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.076675] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.076675] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 3e85edce-fa8a-45d4-b109-5bdd98a06303 is going to be created. [ 1181.097797] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.097960] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.098050] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.098300] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.098555] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.098824] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-3e85edce-fa8a-45d4-b109-5bdd98a06303" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.324494] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.825897] env[69920]: INFO networking_nsxv3.common.synchronization [req-99a75858-0c06-426a-bbfa-c9314904ce90 req-2ad390a7-a283-4faa-9379-c0a1db6e91b9 service nova] Enqueued Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_rules [ 1181.826234] env[69920]: INFO networking_nsxv3.common.synchronization [req-99a75858-0c06-426a-bbfa-c9314904ce90 req-2ad390a7-a283-4faa-9379-c0a1db6e91b9 service nova] Enqueued Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_members [ 1181.826404] env[69920]: INFO networking_nsxv3.common.synchronization [req-99a75858-0c06-426a-bbfa-c9314904ce90 req-2ad390a7-a283-4faa-9379-c0a1db6e91b9 service nova] Enqueued Resource ID: 3e85edce-fa8a-45d4-b109-5bdd98a06303 with Priority: HIGHEST for action port [ 1181.827309] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_rules [ 1181.827309] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_members [ 1181.827309] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e85edce-fa8a-45d4-b109-5bdd98a06303 with Priority: HIGHEST for action port [ 1181.827542] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.827668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.829911] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.829911] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.829911] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.829911] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be updated. [ 1181.830245] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.830245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.830245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.830499] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.830499] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.835189] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.835189] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.835405] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e85edce-fa8a-45d4-b109-5bdd98a06303 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.835776] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e85edce-fa8a-45d4-b109-5bdd98a06303" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.835776] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e85edce-fa8a-45d4-b109-5bdd98a06303" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.836586] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e85edce-fa8a-45d4-b109-5bdd98a06303" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.836730] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e85edce-fa8a-45d4-b109-5bdd98a06303',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.879026] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.879146] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.879221] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.879436] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.879584] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.889607] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: IN_PROGRESS for 2s [ 1182.339439] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.339622] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.339871] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e85edce-fa8a-45d4-b109-5bdd98a06303 with status ACTIVE [ 1182.340148] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.340334] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.340334] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.340562] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.341199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.341199] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.341199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.341199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.341395] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.341441] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.341626] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.341732] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.341788] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.341941] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.342072] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.342258] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e85edce-fa8a-45d4-b109-5bdd98a06303 is going to be updated. [ 1182.367378] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.367565] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.367618] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.367873] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.368260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.368260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e85edce-fa8a-45d4-b109-5bdd98a06303" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.603044] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6706e233-99bc-4f71-accd-d13e8c487aed in Status: SUCCESS [ 1182.603290] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.603504] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.603742] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.603986] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.604125] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.604191] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.604369] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.604486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.604598] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.604733] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6706e233-99bc-4f71-accd-d13e8c487aed',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.677641] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: SUCCESS [ 1182.677828] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b deletion is rescheduled due to dependency. [ 1182.677945] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.678144] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.678398] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.678693] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.678821] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.678889] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.679071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.679157] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.679257] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.107708] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6706e233-99bc-4f71-accd-d13e8c487aed',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.181459] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.611089] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6706e233-99bc-4f71-accd-d13e8c487aed: rpc.has_security_group_logging(os_id): False [ 1183.637821] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.637983] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.638056] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.638270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.638625] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.638847] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.638952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.638952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.639132] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.639213] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.639307] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6706e233-99bc-4f71-accd-d13e8c487aed is going to be updated. [ 1183.684431] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.725104] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.725315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.725359] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.725570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.725716] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.739810] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6706e233-99bc-4f71-accd-d13e8c487aed in Status: IN_PROGRESS for 2s [ 1183.904015] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: SUCCESS [ 1183.904276] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.904450] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.904725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.904929] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.905062] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.905126] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.905284] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.905368] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.905455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.905557] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.186119] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.186119] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.186119] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.186639] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.186639] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.186639] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b is going to be updated. [ 1184.223305] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.223452] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.223525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.223941] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.224184] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.234747] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: IN_PROGRESS for 2s [ 1184.408668] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.408901] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.408967] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.409221] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.409398] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.409498] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.409584] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.409775] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.409887] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.410040] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.410146] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.410215] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.410277] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.410420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.410559] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.410654] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.410714] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.410899] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.410974] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.411068] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.411192] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.914298] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fdaff9b-63be-497c-8622-3160e739856a: rpc.has_security_group_logging(os_id): False [ 1184.939028] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.939028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.939028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.939348] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.939348] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.940155] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.940155] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.940155] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.940155] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.940155] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.940155] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.940442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.940442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.940442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.940523] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.940885] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.941027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.941115] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.941238] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.941315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.941402] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be updated. [ 1185.002523] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.002764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.002764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.002996] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.003191] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.018923] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: IN_PROGRESS for 2s [ 1185.708664] env[69920]: INFO networking_nsxv3.common.synchronization [req-f9a5ab49-7944-49fb-8e17-95e7427b7ab8 req-45a35036-9e82-4504-bb26-eea4233f4474 tempest-ServerRescueNegativeTestJSON-1943285071 tempest-ServerRescueNegativeTestJSON-1943285071-project-member] Enqueued Resource ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 with Priority: HIGHEST for action security_group_members [ 1185.712018] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 with Priority: HIGHEST for action security_group_members [ 1185.712018] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b36777-ea5b-4b29-980a-dc95fc42eb85 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.712018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.712018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.712018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.712018] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.712018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.712018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.712018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.712018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.712018] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21b36777-ea5b-4b29-980a-dc95fc42eb85',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.753654] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6706e233-99bc-4f71-accd-d13e8c487aed in Status: SUCCESS [ 1185.753890] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.177945] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-215 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.178194] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.178364] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.178707] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.179031] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.179192] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.179322] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.179547] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.179737] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.179959] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1186.180110] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1186.180224] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1186.180340] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1186.180457] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1186.180569] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1186.180841] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1186.208254] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1186.208447] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1186.208708] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1186.209079] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-215" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.209618] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-037faf17-cf20-417c-ab4d-b0a08944b7d9 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.209883] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-037faf17-cf20-417c-ab4d-b0a08944b7d9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.210038] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-037faf17-cf20-417c-ab4d-b0a08944b7d9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.210391] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-037faf17-cf20-417c-ab4d-b0a08944b7d9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.210543] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('037faf17-cf20-417c-ab4d-b0a08944b7d9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.215969] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.216117] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.216187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.216531] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.216642] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.216855] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.216975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.217055] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.217218] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.217302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.217389] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 already deleted. [ 1186.217470] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.249797] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: SUCCESS [ 1186.250074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.250259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.250533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.250748] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.250919] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.250994] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.251201] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.251303] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.251424] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.251535] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.714074] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.714499] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.714499] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.714674] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.714828] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.714994] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 037faf17-cf20-417c-ab4d-b0a08944b7d9 not found, creating... [ 1186.715329] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.715545] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.715698] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.715961] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.716364] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.716658] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.716869] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.717077] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.717344] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.717550] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.717821] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 037faf17-cf20-417c-ab4d-b0a08944b7d9 is going to be created. [ 1186.739038] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.739318] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.739457] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.740030] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.740336] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.740589] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-037faf17-cf20-417c-ab4d-b0a08944b7d9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.753610] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.033270] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: SUCCESS [ 1187.033498] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.256256] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ae58702-5520-4afd-abbd-064c34515d9b: rpc.has_security_group_logging(os_id): False [ 1187.278345] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.278543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.278543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.278974] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.278974] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.279280] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.279405] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.279475] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.279650] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.279819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.279887] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b is going to be updated. [ 1187.379021] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.379163] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.379229] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.379527] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.379986] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.398252] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: IN_PROGRESS for 2s [ 1187.797654] env[69920]: INFO networking_nsxv3.common.synchronization [req-f9a5ab49-7944-49fb-8e17-95e7427b7ab8 req-2d1969ef-e20b-4315-a73c-830af99bf5ea service nova] Enqueued Resource ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 with Priority: HIGHEST for action security_group_rules [ 1187.797888] env[69920]: INFO networking_nsxv3.common.synchronization [req-f9a5ab49-7944-49fb-8e17-95e7427b7ab8 req-2d1969ef-e20b-4315-a73c-830af99bf5ea service nova] Enqueued Resource ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 with Priority: HIGHEST for action security_group_members [ 1187.798045] env[69920]: INFO networking_nsxv3.common.synchronization [req-f9a5ab49-7944-49fb-8e17-95e7427b7ab8 req-2d1969ef-e20b-4315-a73c-830af99bf5ea service nova] Enqueued Resource ID: 037faf17-cf20-417c-ab4d-b0a08944b7d9 with Priority: HIGHEST for action port [ 1187.799489] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 with Priority: HIGHEST for action security_group_rules [ 1187.799489] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 with Priority: HIGHEST for action security_group_members [ 1187.799489] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037faf17-cf20-417c-ab4d-b0a08944b7d9 with Priority: HIGHEST for action port [ 1187.799489] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21b36777-ea5b-4b29-980a-dc95fc42eb85 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.800113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.800245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.800452] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.800777] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21b36777-ea5b-4b29-980a-dc95fc42eb85',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.804221] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b36777-ea5b-4b29-980a-dc95fc42eb85 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.804221] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.808000] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.808000] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.808000] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.808000] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.808000] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.808000] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.808000] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.808000] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21b36777-ea5b-4b29-980a-dc95fc42eb85',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.808000] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-037faf17-cf20-417c-ab4d-b0a08944b7d9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.808000] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-037faf17-cf20-417c-ab4d-b0a08944b7d9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.808737] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-037faf17-cf20-417c-ab4d-b0a08944b7d9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.808737] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-037faf17-cf20-417c-ab4d-b0a08944b7d9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.808737] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('037faf17-cf20-417c-ab4d-b0a08944b7d9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.310443] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b36777-ea5b-4b29-980a-dc95fc42eb85 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.310614] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.310974] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21b36777-ea5b-4b29-980a-dc95fc42eb85',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.313432] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 037faf17-cf20-417c-ab4d-b0a08944b7d9 with status ACTIVE [ 1188.313757] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.313757] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.313932] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.314091] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.314146] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.314300] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.314445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.314445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.314635] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.314712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.314967] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.315089] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.315403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.315403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.315403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.315403] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 037faf17-cf20-417c-ab4d-b0a08944b7d9 is going to be updated. [ 1188.338456] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.338456] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.338456] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.338456] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.338456] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.338456] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-037faf17-cf20-417c-ab4d-b0a08944b7d9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.813225] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21b36777-ea5b-4b29-980a-dc95fc42eb85',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.277137] env[69920]: INFO networking_nsxv3.common.synchronization [None req-ee072a49-893c-4dd9-a47c-e7112568f6c9 tempest-AttachInterfacesTestJSON-901858583 tempest-AttachInterfacesTestJSON-901858583-project-member] Enqueued Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 1189.277137] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 1189.277137] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.277137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.277988] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.278500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.279975] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.279975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.279975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.279975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.279975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.279975] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.318239] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.318239] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.318239] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.318239] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.318239] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.318239] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 is going to be created. [ 1189.349070] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.349070] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.349070] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.349070] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.349070] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.358350] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 in Status: UNINITIALIZED for 2s [ 1189.410860] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: SUCCESS [ 1189.411145] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.781623] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.781763] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.781831] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.782072] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.782161] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.785017] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.785017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.785017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.785017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.785017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.785017] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 is going to be updated. [ 1189.813722] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.814223] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.814223] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.814223] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.814377] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.825235] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: IN_PROGRESS for 2s [ 1191.247061] env[69920]: INFO networking_nsxv3.common.synchronization [req-422db256-e919-47c8-95e8-00180d0fb091 req-8c8a6469-7d3e-4df7-a99b-2bd010be55af tempest-ServersTestJSON-738065696 tempest-ServersTestJSON-738065696-project-member] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1191.247669] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1191.247975] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.252222] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.252301] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.252850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.252850] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.252850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.252850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.253038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.253124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.253220] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.370977] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 in Status: SUCCESS [ 1191.371221] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.371713] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.371942] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.372146] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.372276] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.372334] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.372796] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.372796] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.373074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.373231] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21b36777-ea5b-4b29-980a-dc95fc42eb85',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.755414] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.835802] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: SUCCESS [ 1191.836115] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 deletion is rescheduled due to dependency. [ 1191.836260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.875170] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21b36777-ea5b-4b29-980a-dc95fc42eb85',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.916547] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-21 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.916761] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.916896] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.917198] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.917452] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.917614] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.917735] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.917953] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.918375] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.918614] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1191.918767] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1191.918886] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1191.918999] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1191.919129] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1191.919243] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1191.919838] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1191.938958] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1191.939141] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1191.939290] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1191.939468] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.939777] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-d355060d-92db-48c9-ac0c-a82f6c92c904 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.939953] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-d355060d-92db-48c9-ac0c-a82f6c92c904" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.940158] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-d355060d-92db-48c9-ac0c-a82f6c92c904" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.940492] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-d355060d-92db-48c9-ac0c-a82f6c92c904" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.940640] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d355060d-92db-48c9-ac0c-a82f6c92c904',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.257967] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.378574] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21b36777-ea5b-4b29-980a-dc95fc42eb85: rpc.has_security_group_logging(os_id): False [ 1192.400849] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.401074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.401143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.401364] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.401468] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.401785] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.401924] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.402066] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.402470] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.402564] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.402794] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 is going to be created. [ 1192.443563] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.443897] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.444118] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.445577] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.445577] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.445577] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port d355060d-92db-48c9-ac0c-a82f6c92c904 not found, creating... [ 1192.445853] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.446192] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.446415] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.446804] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.447039] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.447946] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.448276] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.448405] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.448756] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.448974] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.449204] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: d355060d-92db-48c9-ac0c-a82f6c92c904 is going to be created. [ 1192.471278] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.471512] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.471643] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.471967] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.472243] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.472830] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-d355060d-92db-48c9-ac0c-a82f6c92c904" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.494517] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.494663] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.494856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.494947] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.495146] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.536923] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 in Status: IN_PROGRESS for 2s [ 1192.763445] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.763445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.763445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.763445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.763445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.763445] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1192.794965] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.795142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.795213] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.795439] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.795594] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.804484] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1193.313587] env[69920]: INFO networking_nsxv3.common.synchronization [req-422db256-e919-47c8-95e8-00180d0fb091 req-18c12d87-9079-47dd-ab67-2bfc9a3d18c9 service nova] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_rules [ 1193.313587] env[69920]: INFO networking_nsxv3.common.synchronization [req-422db256-e919-47c8-95e8-00180d0fb091 req-18c12d87-9079-47dd-ab67-2bfc9a3d18c9 service nova] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1193.313587] env[69920]: INFO networking_nsxv3.common.synchronization [req-422db256-e919-47c8-95e8-00180d0fb091 req-18c12d87-9079-47dd-ab67-2bfc9a3d18c9 service nova] Enqueued Resource ID: d355060d-92db-48c9-ac0c-a82f6c92c904 with Priority: HIGHEST for action port [ 1193.313587] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_rules [ 1193.313587] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1193.313587] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d355060d-92db-48c9-ac0c-a82f6c92c904 with Priority: HIGHEST for action port [ 1193.313587] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.313587] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.313587] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.313587] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.313587] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.317900] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.318133] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.318417] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-d355060d-92db-48c9-ac0c-a82f6c92c904 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.318782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d355060d-92db-48c9-ac0c-a82f6c92c904" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.318900] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d355060d-92db-48c9-ac0c-a82f6c92c904" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.319149] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d355060d-92db-48c9-ac0c-a82f6c92c904" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.319286] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d355060d-92db-48c9-ac0c-a82f6c92c904',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.821968] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.822218] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.822463] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d355060d-92db-48c9-ac0c-a82f6c92c904 with status ACTIVE [ 1193.823342] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.823342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.823342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.823342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.823342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.823342] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.823342] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.823676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.823676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.823676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.824018] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.824018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.824018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.824196] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.824196] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.824269] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d355060d-92db-48c9-ac0c-a82f6c92c904 is going to be updated. [ 1193.845012] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.845227] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.845307] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.845523] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.845670] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.845839] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d355060d-92db-48c9-ac0c-a82f6c92c904" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.550654] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 in Status: SUCCESS [ 1194.551054] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.755856] env[69920]: INFO networking_nsxv3.common.synchronization [None req-8bf5b227-4300-4c3b-be93-e663d825d6c3 None None] Enqueued Resource ID: bc5a3757-6be0-4f2d-a271-cec1db9de9f2 with Priority: HIGHEST for action port [ 1194.756136] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc5a3757-6be0-4f2d-a271-cec1db9de9f2 with Priority: HIGHEST for action port [ 1194.756807] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc5a3757-6be0-4f2d-a271-cec1db9de9f2 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.756974] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc5a3757-6be0-4f2d-a271-cec1db9de9f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.757239] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc5a3757-6be0-4f2d-a271-cec1db9de9f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.757515] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc5a3757-6be0-4f2d-a271-cec1db9de9f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.757601] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc5a3757-6be0-4f2d-a271-cec1db9de9f2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.815579] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1194.815579] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.815579] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.815829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.815965] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.816104] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.816170] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.816333] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.816416] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.816526] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.260379] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc5a3757-6be0-4f2d-a271-cec1db9de9f2 [ 1195.260379] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.260379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.260379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.260379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.260379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.260379] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc5a3757-6be0-4f2d-a271-cec1db9de9f2 already deleted. [ 1195.260379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc5a3757-6be0-4f2d-a271-cec1db9de9f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.319153] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.826208] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.329193] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.329327] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.330549] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.330549] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.330549] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.330549] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1196.362380] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.362380] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.362380] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.362380] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.362380] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.372047] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1197.096246] env[69920]: INFO networking_nsxv3.common.synchronization [None req-847501fa-5185-44a4-8880-90eeab4b71d2 None None] Enqueued Resource ID: 85474a99-bb57-465b-bd79-94d490b59e18 with Priority: HIGHEST for action port [ 1197.096952] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85474a99-bb57-465b-bd79-94d490b59e18 with Priority: HIGHEST for action port [ 1197.101018] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-85474a99-bb57-465b-bd79-94d490b59e18 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.101018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85474a99-bb57-465b-bd79-94d490b59e18" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.101018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85474a99-bb57-465b-bd79-94d490b59e18" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.101018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85474a99-bb57-465b-bd79-94d490b59e18" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.101018] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85474a99-bb57-465b-bd79-94d490b59e18',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.603338] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85474a99-bb57-465b-bd79-94d490b59e18 [ 1197.604875] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.604875] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.604875] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.604875] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.604875] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.604875] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85474a99-bb57-465b-bd79-94d490b59e18 already deleted. [ 1197.604875] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85474a99-bb57-465b-bd79-94d490b59e18" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.385018] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1198.385418] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.385543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.385807] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.386069] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.386244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.386336] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.386639] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.386639] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.386913] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.386975] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.818161] env[69920]: INFO networking_nsxv3.common.synchronization [req-cafce470-7c09-4bdb-a6b1-4635d39a36f9 req-b72cccc2-1576-4ed2-afd3-444a91ffb0d7 tempest-AttachVolumeNegativeTest-700673554 tempest-AttachVolumeNegativeTest-700673554-project-member] Enqueued Resource ID: 26f7f40b-869b-4715-bb99-c61da31c1672 with Priority: HIGHEST for action security_group_members [ 1198.819526] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26f7f40b-869b-4715-bb99-c61da31c1672 with Priority: HIGHEST for action security_group_members [ 1198.819925] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-26f7f40b-869b-4715-bb99-c61da31c1672 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.820071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.820144] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.820620] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.820620] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.820755] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.820755] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.820928] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.821120] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.821120] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26f7f40b-869b-4715-bb99-c61da31c1672',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.889322] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.889453] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.889502] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.889778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.890026] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.890168] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.890270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.890500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.890628] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.890777] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.890953] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.891102] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.891188] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.891346] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.891493] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.891605] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.891667] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.891821] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.891905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.891989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.892877] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.325501] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.325501] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.325501] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.325697] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.325739] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.325918] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.326033] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.326093] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.326257] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.326324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.326411] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26f7f40b-869b-4715-bb99-c61da31c1672 is going to be updated. [ 1199.365526] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.365708] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.365780] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.366074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.366332] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.382010] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26f7f40b-869b-4715-bb99-c61da31c1672 in Status: IN_PROGRESS for 2s [ 1199.397453] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd313130-fb41-4c30-96a8-0facc1385d33: rpc.has_security_group_logging(os_id): False [ 1199.416354] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.416573] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.416727] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.416856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.416955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.417171] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.417321] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.417407] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.417535] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.417616] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.417807] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.417904] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.417990] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.418154] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.418319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.418432] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.418526] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.418623] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.419095] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.419095] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.419095] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1199.484015] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.484276] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.484276] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.484603] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.484889] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.485066] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.485208] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.485466] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.485630] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.485868] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1199.486031] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1199.486138] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1199.486253] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1199.486372] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1199.486436] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1199.486587] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1199.489910] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.489910] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.490104] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.490482] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.490482] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.507908] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1199.514836] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1199.515047] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1199.515199] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1199.515507] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.516081] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-70d5cdb3-0681-41ab-aa95-e5ae4a5245f3 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.516303] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-70d5cdb3-0681-41ab-aa95-e5ae4a5245f3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.516438] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-70d5cdb3-0681-41ab-aa95-e5ae4a5245f3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.516905] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-70d5cdb3-0681-41ab-aa95-e5ae4a5245f3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.517071] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70d5cdb3-0681-41ab-aa95-e5ae4a5245f3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.023271] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.023271] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.023271] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.023505] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.023538] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.023702] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 70d5cdb3-0681-41ab-aa95-e5ae4a5245f3 not found, creating... [ 1200.023972] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.024152] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.024275] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.024509] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.024653] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.024941] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.027994] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.027994] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.027994] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.027994] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.027994] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 70d5cdb3-0681-41ab-aa95-e5ae4a5245f3 is going to be created. [ 1200.050655] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.051725] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.051924] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.052277] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.052570] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.052876] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-70d5cdb3-0681-41ab-aa95-e5ae4a5245f3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.894732] env[69920]: INFO networking_nsxv3.common.synchronization [req-6a04296f-5638-478e-9620-5a8c3110b5fc req-bb17d18f-dbd2-42ec-9446-e31050e852f6 service nova] Enqueued Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_rules [ 1200.895155] env[69920]: INFO networking_nsxv3.common.synchronization [req-6a04296f-5638-478e-9620-5a8c3110b5fc req-bb17d18f-dbd2-42ec-9446-e31050e852f6 service nova] Enqueued Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 1200.897797] env[69920]: INFO networking_nsxv3.common.synchronization [req-6a04296f-5638-478e-9620-5a8c3110b5fc req-bb17d18f-dbd2-42ec-9446-e31050e852f6 service nova] Enqueued Resource ID: 70d5cdb3-0681-41ab-aa95-e5ae4a5245f3 with Priority: HIGHEST for action port [ 1200.897797] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_rules [ 1200.897797] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 1200.897797] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70d5cdb3-0681-41ab-aa95-e5ae4a5245f3 with Priority: HIGHEST for action port [ 1200.897797] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.897797] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.897797] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.897797] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.897797] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.898425] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.898425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.898425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.898425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.898604] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.898604] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.898670] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.898819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.898917] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.899015] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.899752] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-70d5cdb3-0681-41ab-aa95-e5ae4a5245f3 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.899875] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70d5cdb3-0681-41ab-aa95-e5ae4a5245f3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.899970] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70d5cdb3-0681-41ab-aa95-e5ae4a5245f3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.900105] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70d5cdb3-0681-41ab-aa95-e5ae4a5245f3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.900203] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70d5cdb3-0681-41ab-aa95-e5ae4a5245f3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.391415] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26f7f40b-869b-4715-bb99-c61da31c1672 in Status: SUCCESS [ 1201.391587] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26f7f40b-869b-4715-bb99-c61da31c1672 deletion is rescheduled due to dependency. [ 1201.391729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.402321] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.402513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.402636] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.406953] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70d5cdb3-0681-41ab-aa95-e5ae4a5245f3 with status ACTIVE [ 1201.406953] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.406953] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.407098] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.407296] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.407391] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.407592] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.407694] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.407763] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.408161] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.408161] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.408244] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.408303] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.408372] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.408504] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.408582] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.408670] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70d5cdb3-0681-41ab-aa95-e5ae4a5245f3 is going to be updated. [ 1201.430996] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.431186] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.431259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.431470] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.431632] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.431827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70d5cdb3-0681-41ab-aa95-e5ae4a5245f3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.523645] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1201.523645] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.905898] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.132206] env[69920]: INFO networking_nsxv3.common.synchronization [req-56b4a4b2-b8f4-457f-bda5-95654b4bc149 req-8f213394-75cf-48d6-9fe9-64bc1d99d337 tempest-InstanceActionsNegativeTestJSON-2118782426 tempest-InstanceActionsNegativeTestJSON-2118782426-project-member] Enqueued Resource ID: 11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f with Priority: HIGHEST for action security_group_members [ 1202.132206] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f with Priority: HIGHEST for action security_group_members [ 1202.132206] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.132206] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.132206] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.133295] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.133509] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.133651] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.133737] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.133932] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.134059] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.134183] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.410384] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.410384] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.410384] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.410384] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.410661] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.410661] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 is going to be updated. [ 1202.445592] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.445792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.445792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.446027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.446177] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.458121] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: IN_PROGRESS for 2s [ 1202.637565] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.637565] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.637565] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.637565] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.637565] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.637565] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.637565] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.637565] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.637565] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.637565] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.637565] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f already deleted. [ 1202.637565] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.644385] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-996 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.644385] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-996" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.644385] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-996" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.644385] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-996" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.644385] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.644385] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.644385] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.644385] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.644385] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.644385] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1202.644385] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1202.644385] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1202.644872] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1202.644872] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1202.644872] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1202.651349] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1202.671553] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1202.671737] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1202.671878] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1202.672315] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-996" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.672826] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-43c0ab61-f8c2-4ed2-8aa0-effc43628918 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.673086] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-43c0ab61-f8c2-4ed2-8aa0-effc43628918" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.673226] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-43c0ab61-f8c2-4ed2-8aa0-effc43628918" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.673555] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-43c0ab61-f8c2-4ed2-8aa0-effc43628918" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.673699] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43c0ab61-f8c2-4ed2-8aa0-effc43628918',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.992192] env[69920]: INFO networking_nsxv3.common.synchronization [req-5c95dc73-8fae-4720-b854-e72b83573f06 req-6c82c81e-1cd9-4a4a-92d7-0746a6be1038 tempest-AttachInterfacesUnderV243Test-1114553105 tempest-AttachInterfacesUnderV243Test-1114553105-project-member] Enqueued Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGHEST for action security_group_members [ 1202.992976] env[69920]: INFO networking_nsxv3.common.synchronization [req-5c95dc73-8fae-4720-b854-e72b83573f06 req-6c82c81e-1cd9-4a4a-92d7-0746a6be1038 tempest-AttachInterfacesUnderV243Test-1114553105 tempest-AttachInterfacesUnderV243Test-1114553105-project-member] Enqueued Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGHEST for action security_group_rules [ 1202.993152] env[69920]: INFO networking_nsxv3.common.synchronization [req-5c95dc73-8fae-4720-b854-e72b83573f06 req-6c82c81e-1cd9-4a4a-92d7-0746a6be1038 tempest-AttachInterfacesUnderV243Test-1114553105 tempest-AttachInterfacesUnderV243Test-1114553105-project-member] Enqueued Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGHEST for action security_group_members [ 1202.993292] env[69920]: INFO networking_nsxv3.common.synchronization [req-5c95dc73-8fae-4720-b854-e72b83573f06 req-6c82c81e-1cd9-4a4a-92d7-0746a6be1038 tempest-AttachInterfacesUnderV243Test-1114553105 tempest-AttachInterfacesUnderV243Test-1114553105-project-member] Enqueued Resource ID: c1c89675-9c86-4cf9-9c34-fdea74b6cf04 with Priority: HIGHEST for action port [ 1202.993859] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGHEST for action security_group_members [ 1202.993990] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGHEST for action security_group_rules [ 1202.994102] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1c89675-9c86-4cf9-9c34-fdea74b6cf04 with Priority: HIGHEST for action port [ 1202.994365] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-d81f2be6-2daa-4694-bfd3-496e64f467ac taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.994481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.994548] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.994750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.994902] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.994997] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.995066] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.995290] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.995380] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.995472] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.996358] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d81f2be6-2daa-4694-bfd3-496e64f467ac taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.996466] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.996533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.996692] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.996773] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.997554] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1c89675-9c86-4cf9-9c34-fdea74b6cf04 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.997659] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1c89675-9c86-4cf9-9c34-fdea74b6cf04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.997724] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1c89675-9c86-4cf9-9c34-fdea74b6cf04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.997875] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1c89675-9c86-4cf9-9c34-fdea74b6cf04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.997947] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1c89675-9c86-4cf9-9c34-fdea74b6cf04',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.175697] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.175938] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.176166] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.176485] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.176693] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.176924] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 43c0ab61-f8c2-4ed2-8aa0-effc43628918 not found, creating... [ 1203.177098] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.177259] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.177385] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.177613] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.177763] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.178070] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.178233] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.178393] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.178563] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.178936] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.178936] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 43c0ab61-f8c2-4ed2-8aa0-effc43628918 is going to be created. [ 1203.210356] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.210678] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.210823] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.211289] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.211547] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.212678] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-43c0ab61-f8c2-4ed2-8aa0-effc43628918" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.499529] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-d81f2be6-2daa-4694-bfd3-496e64f467ac taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.499756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.500345] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.501017] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1c89675-9c86-4cf9-9c34-fdea74b6cf04 with status ACTIVE [ 1203.501509] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.501509] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.501509] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.501683] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.501713] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.501943] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.502041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.502140] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.502329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.502393] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.502595] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.502722] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.502776] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.502963] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.502963] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.503097] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1c89675-9c86-4cf9-9c34-fdea74b6cf04 is going to be updated. [ 1203.530055] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.530224] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.530345] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.530620] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.530820] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.531043] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1c89675-9c86-4cf9-9c34-fdea74b6cf04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.005853] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.036199] env[69920]: INFO networking_nsxv3.common.synchronization [req-56b4a4b2-b8f4-457f-bda5-95654b4bc149 req-7093011e-8211-4038-87d2-d5bf82ca2959 service nova] Enqueued Resource ID: 11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f with Priority: HIGHEST for action security_group_rules [ 1204.036430] env[69920]: INFO networking_nsxv3.common.synchronization [req-56b4a4b2-b8f4-457f-bda5-95654b4bc149 req-7093011e-8211-4038-87d2-d5bf82ca2959 service nova] Enqueued Resource ID: 11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f with Priority: HIGHEST for action security_group_members [ 1204.036574] env[69920]: INFO networking_nsxv3.common.synchronization [req-56b4a4b2-b8f4-457f-bda5-95654b4bc149 req-7093011e-8211-4038-87d2-d5bf82ca2959 service nova] Enqueued Resource ID: 43c0ab61-f8c2-4ed2-8aa0-effc43628918 with Priority: HIGHEST for action port [ 1204.037667] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f with Priority: HIGHEST for action security_group_rules [ 1204.038112] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f with Priority: HIGHEST for action security_group_members [ 1204.038199] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c0ab61-f8c2-4ed2-8aa0-effc43628918 with Priority: HIGHEST for action port [ 1204.038986] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.039595] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.039706] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.040051] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.040196] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.041586] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.042352] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.042352] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.042352] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.042954] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.043150] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.043282] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.043661] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.044412] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.044412] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.048290] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-43c0ab61-f8c2-4ed2-8aa0-effc43628918 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.048290] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43c0ab61-f8c2-4ed2-8aa0-effc43628918" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.048290] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43c0ab61-f8c2-4ed2-8aa0-effc43628918" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.048290] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43c0ab61-f8c2-4ed2-8aa0-effc43628918" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.048290] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43c0ab61-f8c2-4ed2-8aa0-effc43628918',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.469599] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: SUCCESS [ 1204.469839] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.470068] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.470322] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.470517] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.470640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.470792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.470862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.470947] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.471223] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.471223] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.508721] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.508721] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.508721] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.509080] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.509080] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.509189] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d81f2be6-2daa-4694-bfd3-496e64f467ac is going to be updated. [ 1204.549267] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.549433] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.549474] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.549678] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.549847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.551088] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.552612] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.552612] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.552612] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43c0ab61-f8c2-4ed2-8aa0-effc43628918 with status ACTIVE [ 1204.552612] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.552870] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.552870] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.552946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.553025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.553197] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.553296] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.553353] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.553506] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.553578] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.553752] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.553837] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.553895] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.554040] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.554108] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.554191] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43c0ab61-f8c2-4ed2-8aa0-effc43628918 is going to be updated. [ 1204.565650] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d81f2be6-2daa-4694-bfd3-496e64f467ac in Status: IN_PROGRESS for 2s [ 1204.578974] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.579205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.579289] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.579512] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.579687] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.579860] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43c0ab61-f8c2-4ed2-8aa0-effc43628918" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.821650] env[69920]: INFO networking_nsxv3.common.synchronization [None req-3f035955-64bf-475f-9200-885ef7b6042c tempest-AttachVolumeNegativeTest-700673554 tempest-AttachVolumeNegativeTest-700673554-project-member] Enqueued Resource ID: f396ecc9-2832-4971-bf67-f8c7289f9916 with Priority: HIGHEST for action security_group_rules [ 1204.822364] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f396ecc9-2832-4971-bf67-f8c7289f9916 with Priority: HIGHEST for action security_group_rules [ 1204.822769] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f396ecc9-2832-4971-bf67-f8c7289f9916 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.823627] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.823627] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.823627] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.823836] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f396ecc9-2832-4971-bf67-f8c7289f9916',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.898242] env[69920]: INFO networking_nsxv3.common.synchronization [None req-263e8ce5-30e8-4281-a73e-da662c74ed78 tempest-AttachVolumeNegativeTest-700673554 tempest-AttachVolumeNegativeTest-700673554-project-member] Enqueued Resource ID: f396ecc9-2832-4971-bf67-f8c7289f9916 with Priority: HIGHEST for action security_group_rules [ 1204.898587] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f396ecc9-2832-4971-bf67-f8c7289f9916 with Priority: HIGHEST for action security_group_rules [ 1204.898986] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f396ecc9-2832-4971-bf67-f8c7289f9916 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.900127] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.977187] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.977187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.977187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.977187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.977187] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.977187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.977187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.977187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.977187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.977187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.977187] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.977187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.977187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.977187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.977187] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.977187] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.977798] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.977798] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.977798] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.977798] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.977798] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.055806] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.346864] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.347130] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.347130] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.347326] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.347383] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.347483] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f396ecc9-2832-4971-bf67-f8c7289f9916 already deleted. [ 1205.347561] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.347711] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.347877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.347961] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f396ecc9-2832-4971-bf67-f8c7289f9916',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.482443] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a9f1a73-f43f-451c-8ce2-328d0b73b769: rpc.has_security_group_logging(os_id): False [ 1205.505471] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.505955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.505955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.505955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.506328] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.506328] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.506328] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.506563] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.506563] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.506670] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.507021] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.507157] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.507227] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.507389] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.507471] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.507686] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.507785] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.507850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.507996] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.508077] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.508176] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 is going to be updated. [ 1205.559153] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.559394] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.559394] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.559543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.559633] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.559719] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f is going to be created. [ 1205.589551] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.589799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.589799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.589952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.590129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.596357] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.596570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.596570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.596748] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.596887] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.604337] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f in Status: UNINITIALIZED for 2s [ 1205.611197] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: IN_PROGRESS for 2s [ 1205.835938] env[69920]: INFO networking_nsxv3.common.synchronization [req-6f0cb737-3c62-4bf0-878e-59e9867892fa req-04e199fa-90d6-4d0a-8345-e898a991ef2b tempest-AttachInterfacesUnderV243Test-1114553105 tempest-AttachInterfacesUnderV243Test-1114553105-project-member] Enqueued Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGHEST for action security_group_members [ 1205.835938] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGHEST for action security_group_members [ 1205.835938] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-d81f2be6-2daa-4694-bfd3-496e64f467ac taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.836087] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.855625] env[69920]: INFO networking_nsxv3.common.synchronization [req-6f0cb737-3c62-4bf0-878e-59e9867892fa req-04e199fa-90d6-4d0a-8345-e898a991ef2b tempest-AttachInterfacesUnderV243Test-1114553105 tempest-AttachInterfacesUnderV243Test-1114553105-project-member] Enqueued Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGHEST for action security_group_rules [ 1205.855625] env[69920]: INFO networking_nsxv3.common.synchronization [req-6f0cb737-3c62-4bf0-878e-59e9867892fa req-04e199fa-90d6-4d0a-8345-e898a991ef2b tempest-AttachInterfacesUnderV243Test-1114553105 tempest-AttachInterfacesUnderV243Test-1114553105-project-member] Enqueued Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGHEST for action security_group_members [ 1205.855625] env[69920]: INFO networking_nsxv3.common.synchronization [req-6f0cb737-3c62-4bf0-878e-59e9867892fa req-04e199fa-90d6-4d0a-8345-e898a991ef2b tempest-AttachInterfacesUnderV243Test-1114553105 tempest-AttachInterfacesUnderV243Test-1114553105-project-member] Enqueued Resource ID: c1c89675-9c86-4cf9-9c34-fdea74b6cf04 with Priority: HIGHEST for action port [ 1205.855625] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGHEST for action security_group_rules [ 1205.855625] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGHEST for action security_group_members [ 1205.855625] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1c89675-9c86-4cf9-9c34-fdea74b6cf04 with Priority: HIGHEST for action port [ 1205.855625] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d81f2be6-2daa-4694-bfd3-496e64f467ac taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.855625] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.855625] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-d81f2be6-2daa-4694-bfd3-496e64f467ac taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.855625] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.855625] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1c89675-9c86-4cf9-9c34-fdea74b6cf04 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.855625] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1c89675-9c86-4cf9-9c34-fdea74b6cf04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.855625] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1c89675-9c86-4cf9-9c34-fdea74b6cf04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.855625] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1c89675-9c86-4cf9-9c34-fdea74b6cf04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.855625] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1c89675-9c86-4cf9-9c34-fdea74b6cf04',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.873712] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.873712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.873712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.873712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.873712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.873712] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f396ecc9-2832-4971-bf67-f8c7289f9916 already deleted. [ 1205.873712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.359421] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1c89675-9c86-4cf9-9c34-fdea74b6cf04 with status ACTIVE [ 1206.359774] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.359843] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.359938] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.361181] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.361181] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.361181] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.361181] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.361181] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.361181] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.361181] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.361181] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.361181] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.361181] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.361608] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.361608] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.361608] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1c89675-9c86-4cf9-9c34-fdea74b6cf04 is going to be updated. [ 1206.384032] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.384472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.384472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.384614] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.384646] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.384852] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1c89675-9c86-4cf9-9c34-fdea74b6cf04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.578125] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d81f2be6-2daa-4694-bfd3-496e64f467ac in Status: SUCCESS [ 1206.578340] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.578509] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.578729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.578948] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.579072] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.579137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.579294] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.579367] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.579448] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.579543] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.580428] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.580580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.580726] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.580825] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.580886] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.582247] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.582395] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.583026] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.084391] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.085317] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.234524] env[69920]: INFO networking_nsxv3.common.synchronization [req-ffa0a9f1-94a3-4dca-aaa1-d369cb8f6285 req-14907730-6ed7-41b0-a970-2813a748e2b2 tempest-ServersTestJSON-738065696 tempest-ServersTestJSON-738065696-project-member] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1207.235098] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1207.235576] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.235576] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.235576] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.235767] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.235914] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.240802] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.240802] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.240802] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.240802] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.240802] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.590216] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d81f2be6-2daa-4694-bfd3-496e64f467ac: rpc.has_security_group_logging(os_id): False [ 1207.591481] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.611826] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.612034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.612103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.612275] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.612358] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.612612] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.612703] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.612769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.612940] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.613051] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.613310] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d81f2be6-2daa-4694-bfd3-496e64f467ac is going to be updated. [ 1207.616193] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f in Status: SUCCESS [ 1207.616436] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.618215] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.618455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.618651] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.618764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.618879] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.619057] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.619150] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.619226] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.619325] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.637430] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: SUCCESS [ 1207.637690] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.687544] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.687784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.687828] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.688112] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.688315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.704865] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d81f2be6-2daa-4694-bfd3-496e64f467ac in Status: IN_PROGRESS for 2s [ 1207.744559] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.094237] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.094399] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.094592] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.094665] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.094761] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.094861] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d81f2be6-2daa-4694-bfd3-496e64f467ac is going to be updated. [ 1208.115741] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-21 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.115912] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.115997] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.119497] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.119497] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.119497] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.119497] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.119497] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.119497] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.119497] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1208.119497] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1208.119497] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1208.119497] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1208.119497] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1208.119497] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1208.119497] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1208.122683] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.122832] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.122884] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.123095] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.123280] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.123402] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.123479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.123680] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.123744] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.123826] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.123974] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.124102] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.124227] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.124379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.124524] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.124618] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.125252] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.125428] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.125514] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.125601] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.125876] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.161731] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.161731] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.161731] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.161958] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.162125] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.170384] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1208.170644] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.052 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1208.170849] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1208.171118] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.171574] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-43121e87-0514-4fd2-a304-b280aae31175 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.171817] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-43121e87-0514-4fd2-a304-b280aae31175" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.172008] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-43121e87-0514-4fd2-a304-b280aae31175" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.172461] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-43121e87-0514-4fd2-a304-b280aae31175" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.172667] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43121e87-0514-4fd2-a304-b280aae31175',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.174829] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d81f2be6-2daa-4694-bfd3-496e64f467ac in Status: IN_PROGRESS for 2s [ 1208.247264] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.629064] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f: rpc.has_security_group_logging(os_id): False [ 1208.651481] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.651481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.651481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.651481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.651943] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.651943] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.652178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.652178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.652396] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.652539] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.652864] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.653038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.653679] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.653679] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.653679] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.653928] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.653928] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.654091] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.654186] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.654271] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.654328] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f is going to be created. [ 1208.675833] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.676299] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.676411] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.676674] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.676895] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.677091] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 43121e87-0514-4fd2-a304-b280aae31175 not found, creating... [ 1208.677409] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.677601] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.677732] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.677987] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.678156] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.678574] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.678818] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.679201] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.679476] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.679634] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.679786] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 43121e87-0514-4fd2-a304-b280aae31175 is going to be created. [ 1208.704444] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.704683] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.704830] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.705170] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.705446] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.705707] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-43121e87-0514-4fd2-a304-b280aae31175" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.744032] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.744032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.744032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.744032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.744032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.750380] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.750615] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.750717] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.751076] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.751223] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.751376] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1208.775402] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f in Status: IN_PROGRESS for 2s [ 1208.810199] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.810199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.810199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.810504] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.810658] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.821728] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1209.631520] env[69920]: INFO networking_nsxv3.common.synchronization [req-ffa0a9f1-94a3-4dca-aaa1-d369cb8f6285 req-02a57c55-8387-48a0-b894-eea81db21a9d service nova] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_rules [ 1209.631810] env[69920]: INFO networking_nsxv3.common.synchronization [req-ffa0a9f1-94a3-4dca-aaa1-d369cb8f6285 req-02a57c55-8387-48a0-b894-eea81db21a9d service nova] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1209.632027] env[69920]: INFO networking_nsxv3.common.synchronization [req-ffa0a9f1-94a3-4dca-aaa1-d369cb8f6285 req-02a57c55-8387-48a0-b894-eea81db21a9d service nova] Enqueued Resource ID: 43121e87-0514-4fd2-a304-b280aae31175 with Priority: HIGHEST for action port [ 1209.632289] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_rules [ 1209.632418] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1209.632514] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43121e87-0514-4fd2-a304-b280aae31175 with Priority: HIGHEST for action port [ 1209.633351] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.633513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.633587] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.633801] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.633886] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.638741] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.638741] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.638741] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-43121e87-0514-4fd2-a304-b280aae31175 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.638741] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43121e87-0514-4fd2-a304-b280aae31175" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.638741] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43121e87-0514-4fd2-a304-b280aae31175" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.638741] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43121e87-0514-4fd2-a304-b280aae31175" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.638741] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43121e87-0514-4fd2-a304-b280aae31175',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.720527] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d81f2be6-2daa-4694-bfd3-496e64f467ac in Status: SUCCESS [ 1209.720672] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.720865] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.721094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.721183] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.124125] env[69920]: INFO networking_nsxv3.common.synchronization [req-e876f092-ee41-4c38-a1ec-b25fe68c3e2e req-a588b958-2335-4d96-b528-b9224104f24f tempest-AttachInterfacesUnderV243Test-1114553105 tempest-AttachInterfacesUnderV243Test-1114553105-project-member] Enqueued Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGHEST for action security_group_members [ 1210.124125] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGHEST for action security_group_members [ 1210.124125] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-d81f2be6-2daa-4694-bfd3-496e64f467ac taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.124443] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.138039] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.138039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.138039] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43121e87-0514-4fd2-a304-b280aae31175 with status ACTIVE [ 1210.138039] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.138039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.138039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.138360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.138360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.138504] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.138608] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.138670] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.139254] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.139254] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.139254] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.139254] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.139593] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.139593] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.139593] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.139593] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43121e87-0514-4fd2-a304-b280aae31175 is going to be updated. [ 1210.166441] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.166662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.166662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.166878] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.167025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.167195] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43121e87-0514-4fd2-a304-b280aae31175" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.185202] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d81f2be6-2daa-4694-bfd3-496e64f467ac in Status: SUCCESS [ 1210.185429] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.185595] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.185810] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.186029] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.186132] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.186198] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.186384] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.186466] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.186562] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.224020] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-d81f2be6-2daa-4694-bfd3-496e64f467ac taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.224277] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.688928] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.689339] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.689339] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.689458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.689526] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.689695] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.689788] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.689981] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.690217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.690313] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.690421] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d81f2be6-2daa-4694-bfd3-496e64f467ac is going to be updated. [ 1210.720990] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.721534] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.721534] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.721534] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.721761] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.732025] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d81f2be6-2daa-4694-bfd3-496e64f467ac in Status: IN_PROGRESS for 2s [ 1210.792452] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f in Status: SUCCESS [ 1210.792452] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.834254] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1210.834254] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.834254] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.834254] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.834254] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.834254] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.834254] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.835048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.835048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.835048] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.904634] env[69920]: INFO networking_nsxv3.common.synchronization [req-7800d223-5153-458e-9b29-5886143771ca req-e1e851d6-f176-45da-b57f-433d0836ddfa tempest-ServersNegativeTestJSON-1512944231 tempest-ServersNegativeTestJSON-1512944231-project-member] Enqueued Resource ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 with Priority: HIGHEST for action security_group_members [ 1210.906082] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 with Priority: HIGHEST for action security_group_members [ 1210.906440] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff50f1ab-6b6a-400e-a79f-0d29ae875687 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.906568] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.906634] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.907028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.907028] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.907261] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.907261] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.907326] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.907429] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.907506] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.337490] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.409508] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.409721] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.409840] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.410120] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.410268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.410573] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.411595] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.411595] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.411595] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.411595] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.411595] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 is going to be updated. [ 1211.447542] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.447775] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.447872] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.448113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.448405] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.460950] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 in Status: IN_PROGRESS for 2s [ 1211.840205] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.342590] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.342756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.342828] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.343070] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.343161] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.343264] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1212.376351] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.376581] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.376581] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.377097] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.377097] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.387633] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1212.742619] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d81f2be6-2daa-4694-bfd3-496e64f467ac in Status: SUCCESS [ 1212.742619] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d81f2be6-2daa-4694-bfd3-496e64f467ac deletion is rescheduled due to dependency. [ 1212.742619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.742829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.744638] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.744638] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.744638] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.744638] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.744638] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.744638] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.744638] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.246567] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.246852] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.246852] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.247144] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.247224] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.247439] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.247538] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.247609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.247767] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.247840] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.247926] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d81f2be6-2daa-4694-bfd3-496e64f467ac is going to be updated. [ 1213.284014] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.284233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.284296] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.284519] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.284660] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.297195] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d81f2be6-2daa-4694-bfd3-496e64f467ac in Status: IN_PROGRESS for 2s [ 1213.471846] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 in Status: SUCCESS [ 1213.472033] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 deletion is rescheduled due to dependency. [ 1213.472169] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.580317] env[69920]: INFO networking_nsxv3.common.synchronization [req-b4e4535b-bb27-4187-ae02-b28cc7f472f2 req-fa5c938e-bbb7-45d7-a6d7-11f8f01ca09b tempest-AttachVolumeNegativeTest-700673554 tempest-AttachVolumeNegativeTest-700673554-project-member] Enqueued Resource ID: f396ecc9-2832-4971-bf67-f8c7289f9916 with Priority: HIGHEST for action security_group_members [ 1213.580925] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f396ecc9-2832-4971-bf67-f8c7289f9916 with Priority: HIGHEST for action security_group_members [ 1213.581273] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f396ecc9-2832-4971-bf67-f8c7289f9916 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.581725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.581725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.581725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.581908] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.582014] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.582060] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.582423] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.582528] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.582630] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f396ecc9-2832-4971-bf67-f8c7289f9916',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.009814] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.010062] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-861" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.010214] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-861" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.010492] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-861" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.010793] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.010963] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.011105] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.011404] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.011587] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.011895] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1214.012032] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1214.012153] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1214.012277] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1214.012396] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1214.012521] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1214.012663] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1214.032205] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1214.032421] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1214.032577] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1214.032890] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-861" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.033313] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-e257b275-32fb-40b6-be25-78208eb9442e taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.033519] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-e257b275-32fb-40b6-be25-78208eb9442e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.033652] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-e257b275-32fb-40b6-be25-78208eb9442e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.034079] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-e257b275-32fb-40b6-be25-78208eb9442e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.034280] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e257b275-32fb-40b6-be25-78208eb9442e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.086583] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.086583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.086583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.086583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.086919] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.086919] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.087534] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.087534] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.087534] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.087534] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.087534] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f396ecc9-2832-4971-bf67-f8c7289f9916 already deleted. [ 1214.087534] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.402281] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1214.402752] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.403036] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.403400] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.403655] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.403823] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.403901] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.404132] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.404230] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.404349] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.404463] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.537056] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.537332] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.537457] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.537733] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.537888] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.538062] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port e257b275-32fb-40b6-be25-78208eb9442e not found, creating... [ 1214.538337] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.538512] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.538619] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.538845] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.539091] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.539399] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.539561] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.539684] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.539903] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.540057] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.540222] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: e257b275-32fb-40b6-be25-78208eb9442e is going to be created. [ 1214.562929] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.563166] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.563288] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.563593] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.563807] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.564057] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-e257b275-32fb-40b6-be25-78208eb9442e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.907556] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.907701] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.907782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.907993] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.908173] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.908276] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.908341] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.908551] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.908685] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.908801] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.908985] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.909104] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.909166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.909310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.909447] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.910309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.910309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.910309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.910309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.910309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.910309] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.309319] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d81f2be6-2daa-4694-bfd3-496e64f467ac in Status: SUCCESS [ 1215.309481] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d81f2be6-2daa-4694-bfd3-496e64f467ac deletion is rescheduled due to dependency. [ 1215.309599] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.309769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.309992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.313384] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.313384] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.313384] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.313384] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.313384] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.313384] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.313384] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.412587] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd313130-fb41-4c30-96a8-0facc1385d33: rpc.has_security_group_logging(os_id): False [ 1215.430264] env[69920]: INFO networking_nsxv3.common.synchronization [req-b4e4535b-bb27-4187-ae02-b28cc7f472f2 req-7ac4a086-5335-40bb-a5ea-e9e840fa49c8 service nova] Enqueued Resource ID: f396ecc9-2832-4971-bf67-f8c7289f9916 with Priority: HIGHEST for action security_group_rules [ 1215.430559] env[69920]: INFO networking_nsxv3.common.synchronization [req-b4e4535b-bb27-4187-ae02-b28cc7f472f2 req-7ac4a086-5335-40bb-a5ea-e9e840fa49c8 service nova] Enqueued Resource ID: f396ecc9-2832-4971-bf67-f8c7289f9916 with Priority: HIGHEST for action security_group_members [ 1215.430761] env[69920]: INFO networking_nsxv3.common.synchronization [req-b4e4535b-bb27-4187-ae02-b28cc7f472f2 req-7ac4a086-5335-40bb-a5ea-e9e840fa49c8 service nova] Enqueued Resource ID: e257b275-32fb-40b6-be25-78208eb9442e with Priority: HIGHEST for action port [ 1215.431719] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f396ecc9-2832-4971-bf67-f8c7289f9916 with Priority: HIGHEST for action security_group_rules [ 1215.431919] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f396ecc9-2832-4971-bf67-f8c7289f9916 with Priority: HIGHEST for action security_group_members [ 1215.432144] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e257b275-32fb-40b6-be25-78208eb9442e with Priority: HIGHEST for action port [ 1215.432496] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f396ecc9-2832-4971-bf67-f8c7289f9916 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.432675] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.432786] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.433188] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.433296] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f396ecc9-2832-4971-bf67-f8c7289f9916',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.434288] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f396ecc9-2832-4971-bf67-f8c7289f9916 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.434485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.434598] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.434799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.434975] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.435269] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.435372] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.435564] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.435656] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.435779] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f396ecc9-2832-4971-bf67-f8c7289f9916',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.437061] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-e257b275-32fb-40b6-be25-78208eb9442e taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.437177] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e257b275-32fb-40b6-be25-78208eb9442e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.437265] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e257b275-32fb-40b6-be25-78208eb9442e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.437457] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e257b275-32fb-40b6-be25-78208eb9442e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.437556] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e257b275-32fb-40b6-be25-78208eb9442e',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.447183] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.447939] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.447939] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.447939] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.448115] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.448570] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.448983] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.448983] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.449248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.449362] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.449702] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.449841] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.449937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.450170] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.450291] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.450765] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.450911] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.451000] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.451228] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.451346] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.451466] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1215.561141] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.561350] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.561350] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.561589] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.561768] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.580211] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1215.814359] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.939456] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f396ecc9-2832-4971-bf67-f8c7289f9916 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.939986] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.940516] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e257b275-32fb-40b6-be25-78208eb9442e with status ACTIVE [ 1215.940971] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.941246] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.941423] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.941759] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.941989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.944071] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.944071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.944071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.944071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.944071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.944071] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.944071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.944071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.944071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.944071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.944071] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e257b275-32fb-40b6-be25-78208eb9442e is going to be updated. [ 1215.945519] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f396ecc9-2832-4971-bf67-f8c7289f9916',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.969094] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.969094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.969094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.969094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.969094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.969094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e257b275-32fb-40b6-be25-78208eb9442e" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.304376] env[69920]: INFO networking_nsxv3.common.synchronization [req-8b336652-1577-47ea-bd4d-658b4261fb24 req-13694704-09a2-42e3-987a-a1e930e5649f tempest-InstanceActionsNegativeTestJSON-2118782426 tempest-InstanceActionsNegativeTestJSON-2118782426-project-member] Enqueued Resource ID: 11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f with Priority: HIGHEST for action security_group_members [ 1216.306449] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f with Priority: HIGHEST for action security_group_members [ 1216.306449] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.306449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.306449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.306449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.306449] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.306449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.306449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.306449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.306449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.306449] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.315733] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d81f2be6-2daa-4694-bfd3-496e64f467ac: rpc.has_security_group_logging(os_id): False [ 1216.334249] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.335811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.335811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.335811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.335811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.335811] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.335811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.335811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.335811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.335811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.335811] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d81f2be6-2daa-4694-bfd3-496e64f467ac is going to be updated. [ 1216.421626] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.422087] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.422087] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.422272] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.422507] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.442266] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d81f2be6-2daa-4694-bfd3-496e64f467ac in Status: IN_PROGRESS for 2s [ 1216.447648] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f396ecc9-2832-4971-bf67-f8c7289f9916',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.812392] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.812628] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.812708] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.812987] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.813129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.813410] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.813552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.813632] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.813858] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.813956] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.814095] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f is going to be updated. [ 1216.849422] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.849637] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.849717] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.849941] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.850121] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.861736] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f in Status: IN_PROGRESS for 2s [ 1216.951334] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.951621] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.951621] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.952104] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.952104] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.952338] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f396ecc9-2832-4971-bf67-f8c7289f9916 is going to be created. [ 1216.981016] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.981183] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.981248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.981468] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.981635] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.001144] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f396ecc9-2832-4971-bf67-f8c7289f9916 in Status: UNINITIALIZED for 2s [ 1217.596233] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1217.596581] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.460034] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d81f2be6-2daa-4694-bfd3-496e64f467ac in Status: SUCCESS [ 1218.460294] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.874828] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f in Status: SUCCESS [ 1218.875262] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f deletion is rescheduled due to dependency. [ 1218.875262] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.011106] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f396ecc9-2832-4971-bf67-f8c7289f9916 in Status: SUCCESS [ 1219.013454] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.013454] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.013454] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.013454] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.013454] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.013454] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.013454] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.013454] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.013454] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.013454] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f396ecc9-2832-4971-bf67-f8c7289f9916',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.515014] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f396ecc9-2832-4971-bf67-f8c7289f9916',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.609189] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.609415] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.609595] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.609902] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.610598] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.610796] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.610925] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.611203] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.611384] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.611676] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1219.611862] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1219.612060] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1219.612144] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1219.612270] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1219.612398] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1219.612544] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1219.633888] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1219.634097] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1219.634359] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1219.634609] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-885" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.634941] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-70d5cdb3-0681-41ab-aa95-e5ae4a5245f3 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.635136] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-70d5cdb3-0681-41ab-aa95-e5ae4a5245f3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.635271] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-70d5cdb3-0681-41ab-aa95-e5ae4a5245f3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.635533] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-70d5cdb3-0681-41ab-aa95-e5ae4a5245f3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.635674] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70d5cdb3-0681-41ab-aa95-e5ae4a5245f3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.017237] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f396ecc9-2832-4971-bf67-f8c7289f9916: rpc.has_security_group_logging(os_id): False [ 1220.037195] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.037357] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.037438] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.037623] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.037733] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.037948] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.038054] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.038111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.038265] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.038357] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.038418] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f396ecc9-2832-4971-bf67-f8c7289f9916 is going to be created. [ 1220.099553] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.099553] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.099553] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.100020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.100020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.113591] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f396ecc9-2832-4971-bf67-f8c7289f9916 in Status: IN_PROGRESS for 2s [ 1220.138046] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.138337] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.138498] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.138777] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.139011] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.139327] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.139494] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.139616] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.139852] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.140040] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.140328] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.140491] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.140614] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.140831] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.140970] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.141133] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 70d5cdb3-0681-41ab-aa95-e5ae4a5245f3 is going to be updated. [ 1220.169665] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.169913] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.170052] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.170333] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.170543] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.170780] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-70d5cdb3-0681-41ab-aa95-e5ae4a5245f3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.989800] env[69920]: INFO networking_nsxv3.common.synchronization [req-1992886b-3af2-44c3-86e2-616c1b4c30b0 req-cbe1c609-ac51-4733-b0a7-dad3e9925d72 service nova] Enqueued Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_rules [ 1220.989921] env[69920]: INFO networking_nsxv3.common.synchronization [req-1992886b-3af2-44c3-86e2-616c1b4c30b0 req-cbe1c609-ac51-4733-b0a7-dad3e9925d72 service nova] Enqueued Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 1220.990119] env[69920]: INFO networking_nsxv3.common.synchronization [req-1992886b-3af2-44c3-86e2-616c1b4c30b0 req-cbe1c609-ac51-4733-b0a7-dad3e9925d72 service nova] Enqueued Resource ID: 70d5cdb3-0681-41ab-aa95-e5ae4a5245f3 with Priority: HIGHEST for action port [ 1220.990357] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_rules [ 1220.990479] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 1220.990570] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70d5cdb3-0681-41ab-aa95-e5ae4a5245f3 with Priority: HIGHEST for action port [ 1220.991360] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.991545] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.991640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.991870] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.992016] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.996032] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.996032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.996032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.996032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.996032] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.996032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.996032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.996032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.996032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.996032] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.997774] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-70d5cdb3-0681-41ab-aa95-e5ae4a5245f3 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.997934] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70d5cdb3-0681-41ab-aa95-e5ae4a5245f3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.998255] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70d5cdb3-0681-41ab-aa95-e5ae4a5245f3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.998470] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70d5cdb3-0681-41ab-aa95-e5ae4a5245f3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.999060] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70d5cdb3-0681-41ab-aa95-e5ae4a5245f3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.502034] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.503488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.503488] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.503653] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70d5cdb3-0681-41ab-aa95-e5ae4a5245f3 with status ACTIVE [ 1221.503840] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.504078] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.504078] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.504294] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.504401] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.504647] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.504729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.504783] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.504946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.505018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.506886] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.506886] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.507071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.507153] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.508025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.508025] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70d5cdb3-0681-41ab-aa95-e5ae4a5245f3 is going to be updated. [ 1221.529657] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.529979] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.529979] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.530969] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.531210] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.531531] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70d5cdb3-0681-41ab-aa95-e5ae4a5245f3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.010968] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.127430] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f396ecc9-2832-4971-bf67-f8c7289f9916 in Status: SUCCESS [ 1222.127680] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.515311] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.515628] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.515628] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.515851] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.515949] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.516081] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 is going to be updated. [ 1222.558457] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.558647] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.560961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.560961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.560961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.570662] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: IN_PROGRESS for 2s [ 1223.156663] env[69920]: INFO networking_nsxv3.common.synchronization [req-793d5548-5de4-4559-86f6-4a39e66edaad req-a71c5790-f4c4-4ddd-81df-f509955491f8 tempest-DeleteServersTestJSON-1690074738 tempest-DeleteServersTestJSON-1690074738-project-member] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 1223.160952] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGHEST for action security_group_members [ 1223.160952] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.160952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.160952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.160952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.160952] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.160952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.160952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.160952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.160952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.160952] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.665278] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.665655] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.665655] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.665791] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.665905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.666150] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.666253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.666315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.666477] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.666572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.666676] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be updated. [ 1223.701034] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.701302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.701395] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.701638] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.701840] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.715339] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: IN_PROGRESS for 2s [ 1224.584579] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: SUCCESS [ 1224.584736] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.584908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.585165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.585387] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.585563] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.585635] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.585805] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.585890] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.585979] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.586418] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.088668] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.089025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.089025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.089270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.089527] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.089631] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.089631] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.089801] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.089892] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.089985] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.090204] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.090310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.090372] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.090558] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.090651] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.090743] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.090795] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.090934] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.091030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.091113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.091204] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.427330] env[69920]: INFO networking_nsxv3.common.synchronization [req-8d439ae7-3c0f-4d22-bda6-fc748c3b94ae req-6b0cd036-1250-401d-bb92-9c896115b503 tempest-ServersTestJSON-738065696 tempest-ServersTestJSON-738065696-project-member] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1225.429027] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1225.429132] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.429224] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.429313] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.429697] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.430067] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.430147] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.430276] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.430741] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.430741] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.431070] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.593533] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a9f1a73-f43f-451c-8ce2-328d0b73b769: rpc.has_security_group_logging(os_id): False [ 1225.613014] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.613196] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.613274] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.613476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.613568] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.613782] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.613918] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.614129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.614129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.614203] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.614378] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.614470] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.614530] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.614668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.614741] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.614957] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.615058] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.615121] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.615261] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.615334] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.615418] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 is going to be updated. [ 1225.680738] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.680952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.681147] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.681420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.681720] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.696125] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: IN_PROGRESS for 2s [ 1225.727164] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fdaff9b-63be-497c-8622-3160e739856a in Status: SUCCESS [ 1225.727354] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fdaff9b-63be-497c-8622-3160e739856a deletion is rescheduled due to dependency. [ 1225.727471] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.934635] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.438022] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.939751] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.939953] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.940070] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.940365] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.940471] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.940578] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1226.969673] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.969844] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.969988] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.970216] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.970363] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.979256] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1227.501306] env[69920]: INFO networking_nsxv3.common.synchronization [req-159d7622-6fbc-4d38-a8c3-7aab68d38602 req-f09e17c3-f568-4a92-b0f7-4df4161891a5 tempest-ListServerFiltersTestJSON-532103941 tempest-ListServerFiltersTestJSON-532103941-project-member] Enqueued Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_members [ 1227.501950] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_members [ 1227.502285] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-60c7134e-2e86-428f-b754-45baab82ae62 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.502411] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.502477] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.502737] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.502895] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.503007] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.503074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.503232] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.503320] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.503414] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.708487] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: SUCCESS [ 1227.708730] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.781122] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-54 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.781368] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-54" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.781480] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-54" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.781807] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-54" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.782111] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.782715] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.782715] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.782715] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.782974] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.783018] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1227.783489] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1227.783489] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1227.783489] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1227.783489] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1227.783660] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1227.783690] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1227.802633] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1227.802826] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1227.802970] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1227.803226] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-54" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.803612] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-571ec5f9-628f-4a79-8f19-13c41eb94377 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.803797] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-571ec5f9-628f-4a79-8f19-13c41eb94377" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.803924] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-571ec5f9-628f-4a79-8f19-13c41eb94377" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.804262] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-571ec5f9-628f-4a79-8f19-13c41eb94377" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.804411] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('571ec5f9-628f-4a79-8f19-13c41eb94377',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.005616] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.005750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.005750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.006729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.006729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.006729] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.006729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.006729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.006729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.006729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.006729] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60c7134e-2e86-428f-b754-45baab82ae62 already deleted. [ 1228.006729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.306472] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.306673] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.306673] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.307107] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.307351] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.307548] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 571ec5f9-628f-4a79-8f19-13c41eb94377 not found, creating... [ 1228.307840] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.308071] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.308237] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.308495] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.308671] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.309008] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.309213] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.309346] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.309560] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.309703] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.309845] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 571ec5f9-628f-4a79-8f19-13c41eb94377 is going to be created. [ 1228.330114] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.330410] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.330493] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.330777] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.331031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.331278] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-571ec5f9-628f-4a79-8f19-13c41eb94377" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.990976] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1228.991279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.025924] env[69920]: INFO networking_nsxv3.common.synchronization [req-159d7622-6fbc-4d38-a8c3-7aab68d38602 req-ac60d17c-eb72-48a4-b0bb-b161ec0e67a4 service nova] Enqueued Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_rules [ 1229.026127] env[69920]: INFO networking_nsxv3.common.synchronization [req-159d7622-6fbc-4d38-a8c3-7aab68d38602 req-ac60d17c-eb72-48a4-b0bb-b161ec0e67a4 service nova] Enqueued Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_members [ 1229.026271] env[69920]: INFO networking_nsxv3.common.synchronization [req-159d7622-6fbc-4d38-a8c3-7aab68d38602 req-ac60d17c-eb72-48a4-b0bb-b161ec0e67a4 service nova] Enqueued Resource ID: 571ec5f9-628f-4a79-8f19-13c41eb94377 with Priority: HIGHEST for action port [ 1229.026508] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_rules [ 1229.026645] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_members [ 1229.026731] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 571ec5f9-628f-4a79-8f19-13c41eb94377 with Priority: HIGHEST for action port [ 1229.027299] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60c7134e-2e86-428f-b754-45baab82ae62 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.027423] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.027752] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.027752] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.027848] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.028673] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-60c7134e-2e86-428f-b754-45baab82ae62 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.028795] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.028843] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.029016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.029199] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.029299] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.029357] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.029501] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.029604] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.029667] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.030495] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-571ec5f9-628f-4a79-8f19-13c41eb94377 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.032169] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-571ec5f9-628f-4a79-8f19-13c41eb94377" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.032267] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-571ec5f9-628f-4a79-8f19-13c41eb94377" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.032700] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-571ec5f9-628f-4a79-8f19-13c41eb94377" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.032700] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('571ec5f9-628f-4a79-8f19-13c41eb94377',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.534872] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 571ec5f9-628f-4a79-8f19-13c41eb94377 with status ACTIVE [ 1229.535245] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.535450] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.535556] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.535844] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.537055] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.537055] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.537055] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.537055] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.537055] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.537055] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.537055] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.538049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.538049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.538049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.538049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.538391] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 571ec5f9-628f-4a79-8f19-13c41eb94377 is going to be updated. [ 1229.539470] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.540533] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-60c7134e-2e86-428f-b754-45baab82ae62 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.540533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.564399] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.564797] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.564797] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.564797] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.564971] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.565115] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-571ec5f9-628f-4a79-8f19-13c41eb94377" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.041872] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.544879] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.545121] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.545230] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.545380] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.545487] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.545591] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60c7134e-2e86-428f-b754-45baab82ae62 is going to be created. [ 1230.568507] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.568667] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.568740] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.568966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.569176] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.578463] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60c7134e-2e86-428f-b754-45baab82ae62 in Status: UNINITIALIZED for 2s [ 1232.118834] env[69920]: INFO networking_nsxv3.common.synchronization [req-08e5d664-778e-4a75-87fa-1ce833164e8e req-9ac988e0-79c2-4708-9d01-00fb2af70f0f tempest-ListServerFiltersTestJSON-532103941 tempest-ListServerFiltersTestJSON-532103941-project-member] Enqueued Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_members [ 1232.118834] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_members [ 1232.119460] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-60c7134e-2e86-428f-b754-45baab82ae62 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.119460] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.394917] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-54 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.395012] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-54" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.395161] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-54" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.395520] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-54" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.395815] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.396024] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.396289] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.396895] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.396895] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.396895] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1232.397043] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1232.397148] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1232.397204] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1232.397342] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1232.397458] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1232.397660] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1232.421896] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1232.422173] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1232.422682] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1232.422682] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-54" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.422815] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-340dd818-a9e9-44ba-8a3b-a6bf475270e5 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.423017] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-340dd818-a9e9-44ba-8a3b-a6bf475270e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.423144] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-340dd818-a9e9-44ba-8a3b-a6bf475270e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.423512] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-340dd818-a9e9-44ba-8a3b-a6bf475270e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.424280] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('340dd818-a9e9-44ba-8a3b-a6bf475270e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.588803] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60c7134e-2e86-428f-b754-45baab82ae62 in Status: SUCCESS [ 1232.589067] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.589277] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.589617] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.589909] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.590058] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.590126] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.590403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.590403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.590497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.590559] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.591542] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.591721] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.591891] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.591999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.592080] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.592225] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.592365] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.592395] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.926622] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.926930] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.927102] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.927485] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.927647] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.927811] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 340dd818-a9e9-44ba-8a3b-a6bf475270e5 not found, creating... [ 1232.928104] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.928266] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.928494] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.928703] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.928845] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.929242] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.929485] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.929610] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.929874] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.930800] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.930800] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 340dd818-a9e9-44ba-8a3b-a6bf475270e5 is going to be created. [ 1232.954540] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.954825] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.954977] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.955300] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.955573] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.955814] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-340dd818-a9e9-44ba-8a3b-a6bf475270e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.094470] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-60c7134e-2e86-428f-b754-45baab82ae62 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.094666] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.094856] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.597255] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.633675] env[69920]: INFO networking_nsxv3.common.synchronization [req-08e5d664-778e-4a75-87fa-1ce833164e8e req-cf2b19a3-01a0-49fd-a41f-a5e5f498edf9 service nova] Enqueued Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_rules [ 1233.633885] env[69920]: INFO networking_nsxv3.common.synchronization [req-08e5d664-778e-4a75-87fa-1ce833164e8e req-cf2b19a3-01a0-49fd-a41f-a5e5f498edf9 service nova] Enqueued Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_members [ 1233.634054] env[69920]: INFO networking_nsxv3.common.synchronization [req-08e5d664-778e-4a75-87fa-1ce833164e8e req-cf2b19a3-01a0-49fd-a41f-a5e5f498edf9 service nova] Enqueued Resource ID: 340dd818-a9e9-44ba-8a3b-a6bf475270e5 with Priority: HIGHEST for action port [ 1233.634318] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_rules [ 1233.634467] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_members [ 1233.634569] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 340dd818-a9e9-44ba-8a3b-a6bf475270e5 with Priority: HIGHEST for action port [ 1233.635520] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60c7134e-2e86-428f-b754-45baab82ae62 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.635637] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.635860] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-60c7134e-2e86-428f-b754-45baab82ae62 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.635952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.636158] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-340dd818-a9e9-44ba-8a3b-a6bf475270e5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.636275] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-340dd818-a9e9-44ba-8a3b-a6bf475270e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.636362] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-340dd818-a9e9-44ba-8a3b-a6bf475270e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.636572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-340dd818-a9e9-44ba-8a3b-a6bf475270e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.636654] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('340dd818-a9e9-44ba-8a3b-a6bf475270e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.100063] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.100063] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.100063] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.100063] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.100063] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.100063] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60c7134e-2e86-428f-b754-45baab82ae62 is going to be updated. [ 1234.130293] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.130492] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.130539] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.130773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.130937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.138736] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 340dd818-a9e9-44ba-8a3b-a6bf475270e5 with status ACTIVE [ 1234.138903] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.139068] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.139228] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.139400] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.139627] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.139748] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.139868] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.139950] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.140212] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.140445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.140524] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.140619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.140701] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.144028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.144028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.144028] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 340dd818-a9e9-44ba-8a3b-a6bf475270e5 is going to be updated. [ 1234.144028] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60c7134e-2e86-428f-b754-45baab82ae62 in Status: IN_PROGRESS for 2s [ 1234.169315] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.169534] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.169582] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.169791] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.169965] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.170169] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-340dd818-a9e9-44ba-8a3b-a6bf475270e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.470133] env[69920]: INFO networking_nsxv3.common.synchronization [req-eea2e180-697e-490d-a68c-94df0831b930 req-9551817b-e5d2-44bf-a047-88a49385eb0b tempest-ListServerFiltersTestJSON-532103941 tempest-ListServerFiltersTestJSON-532103941-project-member] Enqueued Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_members [ 1234.470557] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_members [ 1234.470769] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-60c7134e-2e86-428f-b754-45baab82ae62 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.470864] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.855020] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-54 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.860031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-54" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.860031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-54" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.860031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-54" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.860031] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.860031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.860031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.860031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.860031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.860031] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1234.860031] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1234.860031] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1234.860031] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1234.860031] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1234.860031] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1234.860031] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1234.881937] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1234.881937] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1234.881937] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1234.881937] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-54" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.882114] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-f6b836b5-0070-4fdc-8398-6bd6efe3e550 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.882197] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-f6b836b5-0070-4fdc-8398-6bd6efe3e550" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.882279] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-f6b836b5-0070-4fdc-8398-6bd6efe3e550" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.882611] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-f6b836b5-0070-4fdc-8398-6bd6efe3e550" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.882773] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6b836b5-0070-4fdc-8398-6bd6efe3e550',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.386070] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.386070] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.386070] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.386468] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.386540] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.386713] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port f6b836b5-0070-4fdc-8398-6bd6efe3e550 not found, creating... [ 1235.387040] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.387249] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.387411] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.387689] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.387881] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.388245] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.388485] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.388692] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.388984] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.389172] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.389382] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: f6b836b5-0070-4fdc-8398-6bd6efe3e550 is going to be created. [ 1235.419780] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.420051] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.420557] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.420964] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.421272] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.421534] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-f6b836b5-0070-4fdc-8398-6bd6efe3e550" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.153317] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60c7134e-2e86-428f-b754-45baab82ae62 in Status: SUCCESS [ 1236.153725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.153725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.153920] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.154131] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.154276] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.154448] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.154498] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.154551] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.154658] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.154801] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-60c7134e-2e86-428f-b754-45baab82ae62 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.154874] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.154939] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.155126] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.155388] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.155544] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.155614] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.155764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.155842] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.155925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.156032] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.156934] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.157146] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.157304] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.157421] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.157485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.157642] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.157717] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.157806] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.257695] env[69920]: INFO networking_nsxv3.common.synchronization [req-eea2e180-697e-490d-a68c-94df0831b930 req-de40bd1a-cab6-4c34-9e2a-6dac122a5b7a service nova] Enqueued Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_rules [ 1236.257695] env[69920]: INFO networking_nsxv3.common.synchronization [req-eea2e180-697e-490d-a68c-94df0831b930 req-de40bd1a-cab6-4c34-9e2a-6dac122a5b7a service nova] Enqueued Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_members [ 1236.257695] env[69920]: INFO networking_nsxv3.common.synchronization [req-eea2e180-697e-490d-a68c-94df0831b930 req-de40bd1a-cab6-4c34-9e2a-6dac122a5b7a service nova] Enqueued Resource ID: f6b836b5-0070-4fdc-8398-6bd6efe3e550 with Priority: HIGHEST for action port [ 1236.257695] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_rules [ 1236.257695] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_members [ 1236.257872] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6b836b5-0070-4fdc-8398-6bd6efe3e550 with Priority: HIGHEST for action port [ 1236.258907] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60c7134e-2e86-428f-b754-45baab82ae62 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.259009] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.262366] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-60c7134e-2e86-428f-b754-45baab82ae62 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.262366] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.262366] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6b836b5-0070-4fdc-8398-6bd6efe3e550 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.262366] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6b836b5-0070-4fdc-8398-6bd6efe3e550" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.262366] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6b836b5-0070-4fdc-8398-6bd6efe3e550" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.262366] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6b836b5-0070-4fdc-8398-6bd6efe3e550" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.262366] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6b836b5-0070-4fdc-8398-6bd6efe3e550',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.663491] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60c7134e-2e86-428f-b754-45baab82ae62: rpc.has_security_group_logging(os_id): False [ 1236.664660] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.682545] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.682545] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.682545] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.682545] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.682545] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.682885] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.682885] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.682885] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.682885] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.683105] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.683167] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.683270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.683330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.683475] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.683566] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.683801] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.683887] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.683949] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.687722] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.687722] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.687722] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60c7134e-2e86-428f-b754-45baab82ae62 is going to be created. [ 1236.752713] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.752713] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.753134] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.753134] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.753412] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.767959] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6b836b5-0070-4fdc-8398-6bd6efe3e550 with status ACTIVE [ 1236.767959] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.772142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.772264] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.772510] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.772607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.772970] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.773105] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.773173] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.773388] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.773489] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.773706] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.773799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.773851] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.773999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.774085] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.774177] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6b836b5-0070-4fdc-8398-6bd6efe3e550 is going to be updated. [ 1236.776243] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60c7134e-2e86-428f-b754-45baab82ae62 in Status: IN_PROGRESS for 2s [ 1236.848324] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.848521] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.848521] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.848731] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.848884] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.849175] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6b836b5-0070-4fdc-8398-6bd6efe3e550" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.166886] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.235492] env[69920]: INFO networking_nsxv3.common.synchronization [req-632b1dae-ef5f-4ede-8165-5a6bc83ca01f req-d35e8e89-608f-40bf-81c8-ddcd0ffc1ab2 tempest-AttachInterfacesTestJSON-901858583 tempest-AttachInterfacesTestJSON-901858583-project-member] Enqueued Resource ID: 6706e233-99bc-4f71-accd-d13e8c487aed with Priority: HIGHEST for action security_group_members [ 1237.235492] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6706e233-99bc-4f71-accd-d13e8c487aed with Priority: HIGHEST for action security_group_members [ 1237.235492] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6706e233-99bc-4f71-accd-d13e8c487aed taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.235492] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.235492] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.235709] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.235709] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.235789] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.235878] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.235986] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.236113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.236206] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6706e233-99bc-4f71-accd-d13e8c487aed',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.670724] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.670902] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.671500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.671500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.671500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.671500] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60c7134e-2e86-428f-b754-45baab82ae62 is going to be updated. [ 1237.713051] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.713214] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.713421] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.714053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.714338] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.726450] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60c7134e-2e86-428f-b754-45baab82ae62 in Status: IN_PROGRESS for 2s [ 1237.738799] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6706e233-99bc-4f71-accd-d13e8c487aed',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.241235] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6706e233-99bc-4f71-accd-d13e8c487aed',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.744256] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.744779] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.744779] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.744779] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.745152] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.745152] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6706e233-99bc-4f71-accd-d13e8c487aed is going to be updated. [ 1238.800430] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60c7134e-2e86-428f-b754-45baab82ae62 in Status: SUCCESS [ 1238.800766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.800842] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.801077] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.801172] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.806386] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.806386] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.806386] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.806386] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.806386] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.817491] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6706e233-99bc-4f71-accd-d13e8c487aed in Status: IN_PROGRESS for 2s [ 1239.081553] env[69920]: INFO networking_nsxv3.common.synchronization [req-31ad6cba-0a32-4495-bf9e-42c25955fa3d req-430caebf-63ac-4852-8a57-49f0048ebbde tempest-ServersTestJSON-738065696 tempest-ServersTestJSON-738065696-project-member] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1239.082062] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1239.082386] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.082514] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.082610] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.082821] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.082974] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.083087] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.083166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.083293] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.083386] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.083500] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.271150] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-436 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.271586] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-436" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.271586] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-436" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.271759] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-436" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.272093] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.272289] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.272418] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.272647] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.272802] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.277043] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1239.277284] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1239.277472] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1239.277587] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1239.277714] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1239.277829] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1239.278139] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1239.298502] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1239.298744] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1239.298848] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1239.299096] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-436" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.299403] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-d201dadc-ab89-4ede-8c29-41217e3af341 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.299656] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-d201dadc-ab89-4ede-8c29-41217e3af341" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.299717] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-d201dadc-ab89-4ede-8c29-41217e3af341" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.299949] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-d201dadc-ab89-4ede-8c29-41217e3af341" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.300097] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d201dadc-ab89-4ede-8c29-41217e3af341',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.303123] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-60c7134e-2e86-428f-b754-45baab82ae62 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.303235] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.585308] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.735796] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60c7134e-2e86-428f-b754-45baab82ae62 in Status: SUCCESS [ 1239.736236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.736236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.736474] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.738116] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.738116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.738116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.738116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.738116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.738116] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.802686] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.802951] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.803031] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.803280] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.803445] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.803745] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.803937] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.804060] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.804286] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.804431] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.804717] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.804879] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.805018] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.805232] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.805451] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.805704] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: d201dadc-ab89-4ede-8c29-41217e3af341 is going to be updated. [ 1239.830163] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.830507] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.830688] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.831040] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.831244] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.831496] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-d201dadc-ab89-4ede-8c29-41217e3af341" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.088032] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.241705] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.590322] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.590725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.590725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.590865] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.590961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.591082] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1240.597337] env[69920]: INFO networking_nsxv3.common.synchronization [req-4edb8a37-ed13-4fba-b129-994714adb2a4 req-1f6b17d1-b860-4a18-865b-640c23415749 service nova] Enqueued Resource ID: fab6b45f-3ae6-4550-ba52-182144930713 with Priority: HIGHEST for action security_group_rules [ 1240.597337] env[69920]: INFO networking_nsxv3.common.synchronization [req-4edb8a37-ed13-4fba-b129-994714adb2a4 req-1f6b17d1-b860-4a18-865b-640c23415749 service nova] Enqueued Resource ID: fab6b45f-3ae6-4550-ba52-182144930713 with Priority: HIGHEST for action security_group_members [ 1240.597457] env[69920]: INFO networking_nsxv3.common.synchronization [req-4edb8a37-ed13-4fba-b129-994714adb2a4 req-1f6b17d1-b860-4a18-865b-640c23415749 service nova] Enqueued Resource ID: d201dadc-ab89-4ede-8c29-41217e3af341 with Priority: HIGHEST for action port [ 1240.598053] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab6b45f-3ae6-4550-ba52-182144930713 with Priority: HIGHEST for action security_group_rules [ 1240.598166] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab6b45f-3ae6-4550-ba52-182144930713 with Priority: HIGHEST for action security_group_members [ 1240.598273] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d201dadc-ab89-4ede-8c29-41217e3af341 with Priority: HIGHEST for action port [ 1240.605637] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fab6b45f-3ae6-4550-ba52-182144930713 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.605799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.605885] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.606400] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.606400] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fab6b45f-3ae6-4550-ba52-182144930713',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.607070] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab6b45f-3ae6-4550-ba52-182144930713 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.607200] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.607273] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.607459] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.607605] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.607703] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.607763] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.607896] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.607972] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.609560] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab6b45f-3ae6-4550-ba52-182144930713',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.610282] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-d201dadc-ab89-4ede-8c29-41217e3af341 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.610421] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d201dadc-ab89-4ede-8c29-41217e3af341" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.610490] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d201dadc-ab89-4ede-8c29-41217e3af341" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.610693] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d201dadc-ab89-4ede-8c29-41217e3af341" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.610773] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d201dadc-ab89-4ede-8c29-41217e3af341',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.612295] env[69920]: INFO networking_nsxv3.common.synchronization [None req-5a5a5407-3988-4a0c-85a1-2bab51cfbe17 None None] Enqueued Resource ID: 3559390d-5018-4911-b220-e0a5368def5a with Priority: HIGHEST for action port [ 1240.614122] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3559390d-5018-4911-b220-e0a5368def5a with Priority: HIGHEST for action port [ 1240.614610] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-3559390d-5018-4911-b220-e0a5368def5a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.614766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3559390d-5018-4911-b220-e0a5368def5a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.614925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3559390d-5018-4911-b220-e0a5368def5a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.615081] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3559390d-5018-4911-b220-e0a5368def5a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.615161] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3559390d-5018-4911-b220-e0a5368def5a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.620776] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.620776] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.620959] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.620993] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.621154] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.631030] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1240.747211] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.827779] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6706e233-99bc-4f71-accd-d13e8c487aed in Status: SUCCESS [ 1240.827999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.113931] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab6b45f-3ae6-4550-ba52-182144930713 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.113931] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.114266] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fab6b45f-3ae6-4550-ba52-182144930713',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.115195] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d201dadc-ab89-4ede-8c29-41217e3af341 with status ACTIVE [ 1241.115328] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.115328] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.115430] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.115602] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.115687] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.115893] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.115955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.117517] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.117517] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.117517] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.117517] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.117517] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.117517] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.117517] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.117517] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.117517] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d201dadc-ab89-4ede-8c29-41217e3af341 is going to be updated. [ 1241.118078] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3559390d-5018-4911-b220-e0a5368def5a [ 1241.118253] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.118350] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.118403] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.118564] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.118640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.118726] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3559390d-5018-4911-b220-e0a5368def5a already deleted. [ 1241.118805] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3559390d-5018-4911-b220-e0a5368def5a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.142785] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.142932] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.142992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.143455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.143455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.143579] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d201dadc-ab89-4ede-8c29-41217e3af341" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.249534] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.249750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.249870] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.250503] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.250503] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.250503] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60c7134e-2e86-428f-b754-45baab82ae62 is going to be updated. [ 1241.290311] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.290493] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.290596] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.290779] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.290923] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.301603] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60c7134e-2e86-428f-b754-45baab82ae62 in Status: IN_PROGRESS for 2s [ 1241.618460] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fab6b45f-3ae6-4550-ba52-182144930713',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.121197] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.121500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.121608] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.122172] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.122172] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.122278] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab6b45f-3ae6-4550-ba52-182144930713 is going to be updated. [ 1242.162760] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.162994] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.162994] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.163204] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.163349] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.174405] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab6b45f-3ae6-4550-ba52-182144930713 in Status: IN_PROGRESS for 2s [ 1242.644017] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1242.644408] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.871353] env[69920]: INFO networking_nsxv3.common.synchronization [None req-f04115a7-ff39-43fb-a775-65f0e12ec5a8 None None] Enqueued Resource ID: ec039831-5ab7-40c7-ae6c-2bd5fabded92 with Priority: HIGHEST for action port [ 1242.871967] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec039831-5ab7-40c7-ae6c-2bd5fabded92 with Priority: HIGHEST for action port [ 1242.872355] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec039831-5ab7-40c7-ae6c-2bd5fabded92 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.872502] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec039831-5ab7-40c7-ae6c-2bd5fabded92" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.872585] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec039831-5ab7-40c7-ae6c-2bd5fabded92" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.872885] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec039831-5ab7-40c7-ae6c-2bd5fabded92" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.872989] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec039831-5ab7-40c7-ae6c-2bd5fabded92',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.311896] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60c7134e-2e86-428f-b754-45baab82ae62 in Status: SUCCESS [ 1243.312134] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.312307] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.312597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.312720] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.312836] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.312903] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.313112] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.313200] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.313299] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.376290] env[69920]: INFO networking_nsxv3.common.synchronization [req-a67978b0-2e72-409e-9205-f99f025ea759 req-c7e97b1f-cff4-45fc-9605-59daa1130082 tempest-AttachInterfacesTestJSON-901858583 tempest-AttachInterfacesTestJSON-901858583-project-member] Enqueued Resource ID: 6706e233-99bc-4f71-accd-d13e8c487aed with Priority: HIGHEST for action security_group_members [ 1243.376968] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6706e233-99bc-4f71-accd-d13e8c487aed with Priority: HIGHEST for action security_group_members [ 1243.377422] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-6706e233-99bc-4f71-accd-d13e8c487aed taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.377606] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.377743] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.378019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.378512] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.379140] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.379184] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.379420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.379553] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.379678] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6706e233-99bc-4f71-accd-d13e8c487aed',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.382037] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec039831-5ab7-40c7-ae6c-2bd5fabded92 [ 1243.382037] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.382037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.382037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.382037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.382037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.382037] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec039831-5ab7-40c7-ae6c-2bd5fabded92 already deleted. [ 1243.382037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec039831-5ab7-40c7-ae6c-2bd5fabded92" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.816028] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.883406] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.883610] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.883610] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.883880] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.884011] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.884260] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.884429] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.884972] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.884972] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.884972] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.884972] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6706e233-99bc-4f71-accd-d13e8c487aed is going to be updated. [ 1243.915932] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.916095] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.916174] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.916385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.916534] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.925946] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6706e233-99bc-4f71-accd-d13e8c487aed in Status: IN_PROGRESS for 2s [ 1244.184909] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab6b45f-3ae6-4550-ba52-182144930713 in Status: SUCCESS [ 1244.185299] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.185588] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.185912] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.186237] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.186431] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.186521] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.186730] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.186829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.186920] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.187028] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fab6b45f-3ae6-4550-ba52-182144930713',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.319089] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.688924] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fab6b45f-3ae6-4550-ba52-182144930713',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.821801] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.822103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.822103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.822325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.822365] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.822450] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60c7134e-2e86-428f-b754-45baab82ae62 is going to be updated. [ 1244.856299] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.856299] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.856299] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.856299] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.856299] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.867238] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60c7134e-2e86-428f-b754-45baab82ae62 in Status: IN_PROGRESS for 2s [ 1245.191599] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fab6b45f-3ae6-4550-ba52-182144930713: rpc.has_security_group_logging(os_id): False [ 1245.212100] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.212234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.212234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.213153] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.213153] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.213153] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.213153] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.213153] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.213153] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.213429] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.213429] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fab6b45f-3ae6-4550-ba52-182144930713 is going to be updated. [ 1245.273854] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.274028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.274072] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.274290] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.274442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.287680] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab6b45f-3ae6-4550-ba52-182144930713 in Status: IN_PROGRESS for 2s [ 1245.936596] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6706e233-99bc-4f71-accd-d13e8c487aed in Status: SUCCESS [ 1245.936884] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6706e233-99bc-4f71-accd-d13e8c487aed deletion is rescheduled due to dependency. [ 1245.936923] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.879388] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60c7134e-2e86-428f-b754-45baab82ae62 in Status: SUCCESS [ 1246.880978] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.880978] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.880978] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.880978] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.880978] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.880978] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.880978] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.880978] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.880978] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.881389] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.302634] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab6b45f-3ae6-4550-ba52-182144930713 in Status: SUCCESS [ 1247.303100] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.384808] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-60c7134e-2e86-428f-b754-45baab82ae62 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.385035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.385035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.385283] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.385459] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.385576] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.385637] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.385782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.385871] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.385960] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.386124] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-60c7134e-2e86-428f-b754-45baab82ae62 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.386251] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.386323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.386476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.386646] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.386810] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.386810] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.386937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.387025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.387087] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.387198] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.889828] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60c7134e-2e86-428f-b754-45baab82ae62: rpc.has_security_group_logging(os_id): False [ 1247.909866] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.910114] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.910277] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.910546] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.910809] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.911035] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.911199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.911302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.911722] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.911848] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.912148] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.912309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.912741] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.912741] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.912741] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.913091] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.913253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.913360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.913583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.913712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.913862] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60c7134e-2e86-428f-b754-45baab82ae62 is going to be updated. [ 1247.982705] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.982922] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.982922] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.983161] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.983313] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.000240] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60c7134e-2e86-428f-b754-45baab82ae62 in Status: IN_PROGRESS for 2s [ 1248.130665] env[69920]: INFO networking_nsxv3.common.synchronization [req-5546fa18-e605-404a-a3b2-8156192f86b0 req-f9e4fb9f-78f0-4fd7-88f0-7c9fc0ec854f tempest-ServerRescueTestJSONUnderV235-236466356 tempest-ServerRescueTestJSONUnderV235-236466356-project-member] Enqueued Resource ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 with Priority: HIGHEST for action security_group_members [ 1248.131279] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 with Priority: HIGHEST for action security_group_members [ 1248.131628] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdb3779b-8847-4ca1-8d11-e82bb873c989 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.131764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.131835] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.132221] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.132437] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.132588] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.132658] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.132785] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.132871] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.132967] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdb3779b-8847-4ca1-8d11-e82bb873c989',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.625659] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-736 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.626104] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-736" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.626104] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-736" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.626554] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-736" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.626871] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.627908] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.628137] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.628431] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.628804] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.629080] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1248.629218] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1248.629407] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1248.629613] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1248.630410] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1248.630572] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1248.630739] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1248.635593] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.635925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.636079] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.636345] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.636491] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.636865] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.637116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.637302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.637520] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.637685] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.637803] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 already deleted. [ 1248.638143] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.655221] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1248.655441] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1248.655576] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1248.655882] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-736" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.656293] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.656497] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.656630] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.657052] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.657328] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.160380] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.161056] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.161056] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.161385] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.161385] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.162042] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2 not found, creating... [ 1249.162042] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.162042] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.162323] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.162377] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.162516] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.163550] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.163960] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.164126] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.164382] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.164855] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.165151] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2 is going to be created. [ 1249.193300] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.194732] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.194732] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.195184] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.195467] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.196692] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.574255] env[69920]: INFO networking_nsxv3.common.synchronization [None req-b3ef57c6-d13f-4609-bfbd-54e40a05c0f8 tempest-AttachInterfacesTestJSON-901858583 tempest-AttachInterfacesTestJSON-901858583-project-member] Enqueued Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 1249.574904] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 with Priority: HIGHEST for action security_group_members [ 1249.575234] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a9f1a73-f43f-451c-8ce2-328d0b73b769 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.575399] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.575584] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.575681] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.575878] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.575987] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.576076] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.576256] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.576413] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.576467] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a9f1a73-f43f-451c-8ce2-328d0b73b769',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.010976] env[69920]: INFO networking_nsxv3.common.synchronization [req-5546fa18-e605-404a-a3b2-8156192f86b0 req-7542c9f9-d8a8-4ee7-8d9e-cc57e095e335 service nova] Enqueued Resource ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 with Priority: HIGHEST for action security_group_rules [ 1250.011358] env[69920]: INFO networking_nsxv3.common.synchronization [req-5546fa18-e605-404a-a3b2-8156192f86b0 req-7542c9f9-d8a8-4ee7-8d9e-cc57e095e335 service nova] Enqueued Resource ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 with Priority: HIGHEST for action security_group_members [ 1250.011358] env[69920]: INFO networking_nsxv3.common.synchronization [req-5546fa18-e605-404a-a3b2-8156192f86b0 req-7542c9f9-d8a8-4ee7-8d9e-cc57e095e335 service nova] Enqueued Resource ID: 1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2 with Priority: HIGHEST for action port [ 1250.011672] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 with Priority: HIGHEST for action security_group_rules [ 1250.011817] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 with Priority: HIGHEST for action security_group_members [ 1250.011920] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2 with Priority: HIGHEST for action port [ 1250.014743] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdb3779b-8847-4ca1-8d11-e82bb873c989 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.014830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.017137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.017137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.017137] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdb3779b-8847-4ca1-8d11-e82bb873c989',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.020992] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdb3779b-8847-4ca1-8d11-e82bb873c989 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.020992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.020992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.020992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.020992] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.020992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.020992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.020992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.020992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.020992] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdb3779b-8847-4ca1-8d11-e82bb873c989',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.020992] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.020992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.020992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.020992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.020992] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.022223] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60c7134e-2e86-428f-b754-45baab82ae62 in Status: SUCCESS [ 1250.022330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.022664] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.022832] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.022910] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.082020] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.082318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.082318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.082479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.082573] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.082812] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.082935] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.083153] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.083227] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.083305] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.083398] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 is going to be updated. [ 1250.112273] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.112597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.112597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.113140] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.113140] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.126899] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: IN_PROGRESS for 2s [ 1250.518572] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdb3779b-8847-4ca1-8d11-e82bb873c989 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.518806] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.522264] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2 with status ACTIVE [ 1250.522590] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.522727] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.522791] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.523041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.523168] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.523456] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.523576] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.523676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.523817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.524398] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.524398] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.524398] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.524398] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.524640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.524640] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.524779] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2 is going to be updated. [ 1250.526237] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdb3779b-8847-4ca1-8d11-e82bb873c989',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.527368] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-60c7134e-2e86-428f-b754-45baab82ae62 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.527526] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.527598] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.527835] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.528016] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.528125] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.528189] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.528349] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.528482] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.528553] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.528671] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.556851] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.557246] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.557246] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.557602] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.557904] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.558199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.031674] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdb3779b-8847-4ca1-8d11-e82bb873c989',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.033182] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-60c7134e-2e86-428f-b754-45baab82ae62 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.033452] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.033533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.033733] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.033960] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.034091] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.034156] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.034331] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.034468] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.034565] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.034717] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-60c7134e-2e86-428f-b754-45baab82ae62 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.034821] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.035132] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.035132] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.035224] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.035302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.035355] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.035499] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.035591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.035681] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.035868] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.538321] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.538481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.538538] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.538759] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.538845] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.538947] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 is going to be created. [ 1251.540179] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60c7134e-2e86-428f-b754-45baab82ae62: rpc.has_security_group_logging(os_id): False [ 1251.564965] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.565200] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.565266] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.565449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.565541] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.565781] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.565895] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.565985] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.566169] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.566301] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.566510] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.566605] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.566669] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.566842] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.566922] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.567132] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.567295] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.567387] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.567540] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.567616] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.567704] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60c7134e-2e86-428f-b754-45baab82ae62 is going to be updated. [ 1251.578317] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.578591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.578591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.578756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.578882] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.589179] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 in Status: UNINITIALIZED for 2s [ 1251.641132] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.641471] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.641471] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.641693] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.641783] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.671683] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60c7134e-2e86-428f-b754-45baab82ae62 in Status: IN_PROGRESS for 2s [ 1252.140910] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 in Status: SUCCESS [ 1252.141565] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a9f1a73-f43f-451c-8ce2-328d0b73b769 deletion is rescheduled due to dependency. [ 1252.141565] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a9f1a73-f43f-451c-8ce2-328d0b73b769" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.332923] env[69920]: INFO networking_nsxv3.common.synchronization [req-dd39d6ef-3fba-4d69-9cde-5fd2d211f0e5 req-6d948c60-f055-4c81-8e84-4d04f755a12e tempest-ServersTestJSON-738065696 tempest-ServersTestJSON-738065696-project-member] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1252.333631] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1252.333951] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.334095] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.334166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.334536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.334617] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.334729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.334792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.334956] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.335059] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.335156] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.699576] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-21 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.699576] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.699576] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.699576] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.699576] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.699938] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.700115] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.700891] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.700891] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.700891] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1252.701086] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1252.701256] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1252.701403] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1252.701579] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1252.701808] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1252.702008] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1252.744762] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1252.745145] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1252.745360] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1252.745610] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.746026] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-1e9afa83-f755-4605-8818-5470b4d2bd50 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.746307] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-1e9afa83-f755-4605-8818-5470b4d2bd50" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.746481] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-1e9afa83-f755-4605-8818-5470b4d2bd50" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.746898] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-1e9afa83-f755-4605-8818-5470b4d2bd50" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.748843] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e9afa83-f755-4605-8818-5470b4d2bd50',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.837763] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.250014] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.250442] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.250442] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.250728] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.250966] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.251178] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 1e9afa83-f755-4605-8818-5470b4d2bd50 not found, creating... [ 1253.254021] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.254021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.254021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.254021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.254021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.254021] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.254021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.254021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.254021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.254021] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.254635] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 1e9afa83-f755-4605-8818-5470b4d2bd50 is going to be created. [ 1253.284036] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.284328] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.284466] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.284774] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.285110] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.285367] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-1e9afa83-f755-4605-8818-5470b4d2bd50" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.340557] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.603169] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 in Status: SUCCESS [ 1253.603408] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.603710] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.604020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.604227] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.604379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.604477] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.604793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.604911] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.605300] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.605466] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fdb3779b-8847-4ca1-8d11-e82bb873c989',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.701421] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60c7134e-2e86-428f-b754-45baab82ae62 in Status: SUCCESS [ 1253.701421] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.843204] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.843387] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.843450] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.843699] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.843870] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.843963] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1253.895453] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.895778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.895778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.896441] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.896597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.909573] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1253.998505] env[69920]: INFO networking_nsxv3.common.synchronization [req-dd39d6ef-3fba-4d69-9cde-5fd2d211f0e5 req-ef3d2137-3b13-4640-a97a-f5d3e558ad40 service nova] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_rules [ 1253.998860] env[69920]: INFO networking_nsxv3.common.synchronization [req-dd39d6ef-3fba-4d69-9cde-5fd2d211f0e5 req-ef3d2137-3b13-4640-a97a-f5d3e558ad40 service nova] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1253.999186] env[69920]: INFO networking_nsxv3.common.synchronization [req-dd39d6ef-3fba-4d69-9cde-5fd2d211f0e5 req-ef3d2137-3b13-4640-a97a-f5d3e558ad40 service nova] Enqueued Resource ID: 1e9afa83-f755-4605-8818-5470b4d2bd50 with Priority: HIGHEST for action port [ 1253.999976] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_rules [ 1254.000202] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1254.000368] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e9afa83-f755-4605-8818-5470b4d2bd50 with Priority: HIGHEST for action port [ 1254.000773] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.001029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.001064] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.001370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.001504] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.002747] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.002908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.003235] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e9afa83-f755-4605-8818-5470b4d2bd50 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.003405] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e9afa83-f755-4605-8818-5470b4d2bd50" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.003530] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e9afa83-f755-4605-8818-5470b4d2bd50" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.003818] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e9afa83-f755-4605-8818-5470b4d2bd50" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.003952] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e9afa83-f755-4605-8818-5470b4d2bd50',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.108336] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdb3779b-8847-4ca1-8d11-e82bb873c989 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.108658] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.108733] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.109019] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.109213] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.109368] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.109439] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.109578] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.109704] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.109889] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.110343] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdb3779b-8847-4ca1-8d11-e82bb873c989 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.110343] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.110343] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.110603] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.110776] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.110882] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.110947] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.111479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.111479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.111619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.111690] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fdb3779b-8847-4ca1-8d11-e82bb873c989',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.506412] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.506810] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.506810] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e9afa83-f755-4605-8818-5470b4d2bd50 with status ACTIVE [ 1254.508217] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.508217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.508217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.508217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.508217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.508589] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.508589] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.508589] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.508708] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.508795] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.509010] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.509087] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.509162] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.509294] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.509434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.509548] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e9afa83-f755-4605-8818-5470b4d2bd50 is going to be updated. [ 1254.535042] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.535294] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.535294] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.535397] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.535552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.535782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e9afa83-f755-4605-8818-5470b4d2bd50" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.613608] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fdb3779b-8847-4ca1-8d11-e82bb873c989: rpc.has_security_group_logging(os_id): False [ 1254.634570] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.634570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.634570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.634570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.634570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.634984] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.634984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.634984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.634984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.634984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.635189] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.635268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.635332] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.635474] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.635551] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.635732] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.635823] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.635886] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.636036] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.636112] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.636196] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 is going to be created. [ 1254.720552] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.720552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.720552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.720846] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.720881] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.732706] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 in Status: IN_PROGRESS for 2s [ 1255.923294] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1255.923680] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.923680] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.923879] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.924080] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.924237] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.924274] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.924425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.924493] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.924586] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.427442] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.745063] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 in Status: SUCCESS [ 1256.745356] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.930748] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.433886] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.433886] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.434150] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.434150] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.434254] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.434349] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1257.473786] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.473928] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.474010] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.474222] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.474368] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.483661] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1259.001513] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1259.001513] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1259.496141] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1259.496333] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.496696] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.496933] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.497143] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.497270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.497349] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.497610] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.497702] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.497849] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.497927] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.760531] env[69920]: INFO networking_nsxv3.common.synchronization [req-b37c52ec-abb9-4588-9c98-2f343053283c req-d449e810-a691-48bd-a2c6-8ee64de2e97c tempest-ListServerFiltersTestJSON-532103941 tempest-ListServerFiltersTestJSON-532103941-project-member] Enqueued Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_members [ 1259.761305] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_members [ 1259.761851] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-60c7134e-2e86-428f-b754-45baab82ae62 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.761921] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.762017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.762340] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.762633] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.762762] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.762881] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.763152] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.763315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.763499] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.000525] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.000749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.000749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.000958] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.001158] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.001263] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.001327] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.001506] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.001646] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.001879] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.001919] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.002024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.002090] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.002257] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.002410] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.002568] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.002568] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.002712] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.002789] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.002874] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.002983] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.265634] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.505921] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd313130-fb41-4c30-96a8-0facc1385d33: rpc.has_security_group_logging(os_id): False [ 1260.529625] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.529814] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.529877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.530061] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.530152] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.530344] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.530556] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.530556] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.531233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.531233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.531233] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.531233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.531233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.531472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.531472] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.531538] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.531717] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.531802] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.531958] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.532093] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.532181] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1260.602023] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.602237] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.602237] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.602470] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.602730] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.627293] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1260.771086] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.274245] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.274621] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.274621] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.274711] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.274819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.274872] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60c7134e-2e86-428f-b754-45baab82ae62 is going to be updated. [ 1261.308457] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.308659] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.308760] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.308914] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.309074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.318041] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60c7134e-2e86-428f-b754-45baab82ae62 in Status: IN_PROGRESS for 2s [ 1262.647076] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1262.647386] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.328226] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60c7134e-2e86-428f-b754-45baab82ae62 in Status: SUCCESS [ 1263.328434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.762788] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1264.763094] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1265.552526] env[69920]: INFO networking_nsxv3.common.synchronization [req-98b649c8-697b-4f85-8cca-a612014a50d0 req-60ca4274-4259-489c-830d-9c4aa10e3187 tempest-ServersTestJSON-738065696 tempest-ServersTestJSON-738065696-project-member] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1265.552526] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1265.553196] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.553196] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.553196] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.553389] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.553652] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.553745] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.553825] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.553965] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.554097] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.554225] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.062044] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.565126] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.067437] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.067854] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.067854] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.067937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.068031] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.068142] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1267.099314] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.099535] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.099591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.099825] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.099973] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.108610] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1267.622565] env[69920]: INFO networking_nsxv3.common.synchronization [req-fe0a7a2d-ba13-4de9-af13-03f2eff415a7 req-9d3ffe43-7ce0-4970-a36d-020c29cb6eb5 tempest-ListServerFiltersTestJSON-532103941 tempest-ListServerFiltersTestJSON-532103941-project-member] Enqueued Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_members [ 1267.623435] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_members [ 1267.623624] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-60c7134e-2e86-428f-b754-45baab82ae62 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.623733] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.623804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.623994] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.625270] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.625448] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.626034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.626034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.626034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.626034] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.129137] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.631552] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.036427] env[69920]: INFO networking_nsxv3.common.synchronization [req-9ba0932b-89f6-4fd5-a904-ff13ee21a4ab req-77dc181d-8485-434c-b557-d75c58646431 tempest-ServerRescueTestJSONUnderV235-236466356 tempest-ServerRescueTestJSONUnderV235-236466356-project-member] Enqueued Resource ID: 2c341293-b79a-440b-999e-788d79379858 with Priority: HIGHEST for action security_group_members [ 1269.036427] env[69920]: INFO networking_nsxv3.common.synchronization [req-9ba0932b-89f6-4fd5-a904-ff13ee21a4ab req-77dc181d-8485-434c-b557-d75c58646431 tempest-ServerRescueTestJSONUnderV235-236466356 tempest-ServerRescueTestJSONUnderV235-236466356-project-member] Enqueued Resource ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 with Priority: HIGHEST for action security_group_members [ 1269.036779] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c341293-b79a-440b-999e-788d79379858 with Priority: HIGHEST for action security_group_members [ 1269.037015] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 with Priority: HIGHEST for action security_group_members [ 1269.037223] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c341293-b79a-440b-999e-788d79379858 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.037395] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c341293-b79a-440b-999e-788d79379858" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.037450] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c341293-b79a-440b-999e-788d79379858" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.037722] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c341293-b79a-440b-999e-788d79379858" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.037879] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.037981] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.038060] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.038206] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.038292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.038384] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c341293-b79a-440b-999e-788d79379858',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.039526] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdb3779b-8847-4ca1-8d11-e82bb873c989 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.039674] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.039736] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.039873] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.040021] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.040119] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.040181] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.040322] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.040399] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.040518] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdb3779b-8847-4ca1-8d11-e82bb873c989',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.081720] env[69920]: INFO networking_nsxv3.common.synchronization [req-9ba0932b-89f6-4fd5-a904-ff13ee21a4ab req-77dc181d-8485-434c-b557-d75c58646431 tempest-ServerRescueTestJSONUnderV235-236466356 tempest-ServerRescueTestJSONUnderV235-236466356-project-member] Enqueued Resource ID: 2c341293-b79a-440b-999e-788d79379858 with Priority: HIGHEST for action security_group_rules [ 1269.081933] env[69920]: INFO networking_nsxv3.common.synchronization [req-9ba0932b-89f6-4fd5-a904-ff13ee21a4ab req-77dc181d-8485-434c-b557-d75c58646431 tempest-ServerRescueTestJSONUnderV235-236466356 tempest-ServerRescueTestJSONUnderV235-236466356-project-member] Enqueued Resource ID: 2c341293-b79a-440b-999e-788d79379858 with Priority: HIGHEST for action security_group_members [ 1269.082110] env[69920]: INFO networking_nsxv3.common.synchronization [req-9ba0932b-89f6-4fd5-a904-ff13ee21a4ab req-77dc181d-8485-434c-b557-d75c58646431 tempest-ServerRescueTestJSONUnderV235-236466356 tempest-ServerRescueTestJSONUnderV235-236466356-project-member] Enqueued Resource ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 with Priority: HIGHEST for action security_group_rules [ 1269.082252] env[69920]: INFO networking_nsxv3.common.synchronization [req-9ba0932b-89f6-4fd5-a904-ff13ee21a4ab req-77dc181d-8485-434c-b557-d75c58646431 tempest-ServerRescueTestJSONUnderV235-236466356 tempest-ServerRescueTestJSONUnderV235-236466356-project-member] Enqueued Resource ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 with Priority: HIGHEST for action security_group_members [ 1269.082403] env[69920]: INFO networking_nsxv3.common.synchronization [req-9ba0932b-89f6-4fd5-a904-ff13ee21a4ab req-77dc181d-8485-434c-b557-d75c58646431 tempest-ServerRescueTestJSONUnderV235-236466356 tempest-ServerRescueTestJSONUnderV235-236466356-project-member] Enqueued Resource ID: 1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2 with Priority: HIGHEST for action port [ 1269.083313] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c341293-b79a-440b-999e-788d79379858 with Priority: HIGHEST for action security_group_rules [ 1269.083487] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 with Priority: HIGHEST for action security_group_rules [ 1269.083593] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2 with Priority: HIGHEST for action port [ 1269.083740] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c341293-b79a-440b-999e-788d79379858 with Priority: HIGHEST for action security_group_members [ 1269.083794] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 with Priority: HIGHEST for action security_group_members [ 1269.084058] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c341293-b79a-440b-999e-788d79379858 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.084179] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c341293-b79a-440b-999e-788d79379858" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.084244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c341293-b79a-440b-999e-788d79379858" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.084496] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c341293-b79a-440b-999e-788d79379858" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.084582] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c341293-b79a-440b-999e-788d79379858',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.086882] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdb3779b-8847-4ca1-8d11-e82bb873c989 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.086882] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.086882] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.086882] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.086882] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdb3779b-8847-4ca1-8d11-e82bb873c989',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.088339] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.088339] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.088339] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.088339] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.088339] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.088865] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c341293-b79a-440b-999e-788d79379858 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.088912] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c341293-b79a-440b-999e-788d79379858" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.089672] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdb3779b-8847-4ca1-8d11-e82bb873c989 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.089672] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.119893] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1269.120107] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.133111] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.133445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.133445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.133548] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.133587] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.133669] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60c7134e-2e86-428f-b754-45baab82ae62 is going to be updated. [ 1269.161072] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.161311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.161311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.161493] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.161688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.172086] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60c7134e-2e86-428f-b754-45baab82ae62 in Status: IN_PROGRESS for 2s [ 1269.336008] env[69920]: INFO networking_nsxv3.common.synchronization [req-6c2a9ade-fe0f-4820-99ab-f83cac673c37 req-e6d2d088-e1b3-46a8-9b0c-baaaa16bf3b6 tempest-ServerRescueTestJSONUnderV235-236466356 tempest-ServerRescueTestJSONUnderV235-236466356-project-member] Enqueued Resource ID: 2c341293-b79a-440b-999e-788d79379858 with Priority: HIGHEST for action security_group_members [ 1269.336219] env[69920]: INFO networking_nsxv3.common.synchronization [req-6c2a9ade-fe0f-4820-99ab-f83cac673c37 req-e6d2d088-e1b3-46a8-9b0c-baaaa16bf3b6 tempest-ServerRescueTestJSONUnderV235-236466356 tempest-ServerRescueTestJSONUnderV235-236466356-project-member] Enqueued Resource ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 with Priority: HIGHEST for action security_group_members [ 1269.336723] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c341293-b79a-440b-999e-788d79379858 with Priority: HIGHEST for action security_group_members [ 1269.336858] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 with Priority: HIGHEST for action security_group_members [ 1269.337137] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c341293-b79a-440b-999e-788d79379858 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.337251] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c341293-b79a-440b-999e-788d79379858" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.337517] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdb3779b-8847-4ca1-8d11-e82bb873c989 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.337589] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.376453] env[69920]: INFO networking_nsxv3.common.synchronization [req-6c2a9ade-fe0f-4820-99ab-f83cac673c37 req-e6d2d088-e1b3-46a8-9b0c-baaaa16bf3b6 tempest-ServerRescueTestJSONUnderV235-236466356 tempest-ServerRescueTestJSONUnderV235-236466356-project-member] Enqueued Resource ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 with Priority: HIGHEST for action security_group_rules [ 1269.376742] env[69920]: INFO networking_nsxv3.common.synchronization [req-6c2a9ade-fe0f-4820-99ab-f83cac673c37 req-e6d2d088-e1b3-46a8-9b0c-baaaa16bf3b6 tempest-ServerRescueTestJSONUnderV235-236466356 tempest-ServerRescueTestJSONUnderV235-236466356-project-member] Enqueued Resource ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 with Priority: HIGHEST for action security_group_members [ 1269.376937] env[69920]: INFO networking_nsxv3.common.synchronization [req-6c2a9ade-fe0f-4820-99ab-f83cac673c37 req-e6d2d088-e1b3-46a8-9b0c-baaaa16bf3b6 tempest-ServerRescueTestJSONUnderV235-236466356 tempest-ServerRescueTestJSONUnderV235-236466356-project-member] Enqueued Resource ID: 1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2 with Priority: HIGHEST for action port [ 1269.377422] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 with Priority: HIGHEST for action security_group_rules [ 1269.377555] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 with Priority: HIGHEST for action security_group_members [ 1269.377655] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2 with Priority: HIGHEST for action port [ 1269.380205] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fdb3779b-8847-4ca1-8d11-e82bb873c989 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.380335] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.380572] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdb3779b-8847-4ca1-8d11-e82bb873c989 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.380694] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.380815] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.380933] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.543142] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c341293-b79a-440b-999e-788d79379858',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.544212] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdb3779b-8847-4ca1-8d11-e82bb873c989',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.586561] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c341293-b79a-440b-999e-788d79379858 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.586755] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c341293-b79a-440b-999e-788d79379858" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.588530] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdb3779b-8847-4ca1-8d11-e82bb873c989 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.588866] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.590184] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2 with status ACTIVE [ 1269.590362] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.590475] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.590542] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.590777] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.590872] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.591051] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.591150] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.591206] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.591361] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.591436] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.591612] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.591704] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.591759] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.591985] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.591985] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.592101] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2 is going to be updated. [ 1269.612997] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.613172] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.613230] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.613433] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.613571] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.613733] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.613884] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.614056] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.614134] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.046454] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c341293-b79a-440b-999e-788d79379858',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.047731] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdb3779b-8847-4ca1-8d11-e82bb873c989',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.115782] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2 with status ACTIVE [ 1270.116036] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.116174] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.116247] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.116477] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.116592] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.116775] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.116877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.116939] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.117117] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.117195] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.117383] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.117480] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.117543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.117688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.117756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.117941] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2 is going to be updated. [ 1270.140818] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.141198] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.141198] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.141276] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.141393] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.141554] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ce221a9-5745-4efe-a99d-f2bcc0d4e7f2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.550719] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.550973] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.551089] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.551374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.551508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.551678] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 is going to be updated. [ 1270.553407] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.553573] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.553676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.553939] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.554030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.555417] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c341293-b79a-440b-999e-788d79379858 is going to be created. [ 1270.577135] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.577379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.577379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.577610] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.577773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.580257] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.580378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.580443] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.580650] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.580807] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.588440] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c341293-b79a-440b-999e-788d79379858 in Status: UNINITIALIZED for 2s [ 1270.589128] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 in Status: IN_PROGRESS for 2s [ 1271.182553] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60c7134e-2e86-428f-b754-45baab82ae62 in Status: SUCCESS [ 1271.182990] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.600812] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 in Status: SUCCESS [ 1272.601448] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.601788] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c341293-b79a-440b-999e-788d79379858 in Status: SUCCESS [ 1272.602523] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c341293-b79a-440b-999e-788d79379858" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.602523] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.602523] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.602523] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.602823] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.602823] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.602823] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.602938] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.602973] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdb3779b-8847-4ca1-8d11-e82bb873c989',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.603895] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c341293-b79a-440b-999e-788d79379858" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.603981] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c341293-b79a-440b-999e-788d79379858" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.604083] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.605250] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.605250] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.605250] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.605250] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.605250] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c341293-b79a-440b-999e-788d79379858',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.106480] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fdb3779b-8847-4ca1-8d11-e82bb873c989',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.107504] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.107674] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.107750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.107963] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.108070] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.108256] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.108357] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.108417] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.108670] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.108670] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.108759] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c341293-b79a-440b-999e-788d79379858 is going to be deleted. [ 1273.137070] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.137293] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.137293] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.137525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.137644] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.137754] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c341293-b79a-440b-999e-788d79379858" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.137900] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c341293-b79a-440b-999e-788d79379858" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.138066] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c341293-b79a-440b-999e-788d79379858" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.138225] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.138323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.138382] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.138521] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.138600] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.138690] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c341293-b79a-440b-999e-788d79379858',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.610360] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fdb3779b-8847-4ca1-8d11-e82bb873c989',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.641587] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.641767] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.641813] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.642131] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.642229] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.642432] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.642535] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.642598] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.642755] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.642831] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.642919] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c341293-b79a-440b-999e-788d79379858 already deleted. [ 1273.643018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c341293-b79a-440b-999e-788d79379858" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.643184] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c341293-b79a-440b-999e-788d79379858" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.643353] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c341293-b79a-440b-999e-788d79379858" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.643511] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.643609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.643671] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.643837] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.643918] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.644017] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c341293-b79a-440b-999e-788d79379858',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.112557] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.112788] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.112869] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.113193] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.113249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.113368] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 is going to be updated. [ 1274.146436] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.146436] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.146727] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.146772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.146976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.148507] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.148679] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.149017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.149017] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.149103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.149369] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.149504] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.149680] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.149872] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.149970] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.150109] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c341293-b79a-440b-999e-788d79379858 already deleted. [ 1274.150207] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c341293-b79a-440b-999e-788d79379858" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.150353] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c341293-b79a-440b-999e-788d79379858',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.159323] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 in Status: IN_PROGRESS for 2s [ 1274.379401] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1274.379609] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=6 [ 1274.653460] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c341293-b79a-440b-999e-788d79379858',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.157325] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c341293-b79a-440b-999e-788d79379858: rpc.has_security_group_logging(os_id): False [ 1275.177879] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.178080] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.178135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.178325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.178417] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.178610] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.178711] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.178765] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.178960] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.179023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.179082] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c341293-b79a-440b-999e-788d79379858 is going to be created. [ 1275.212506] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/2c341293-b79a-440b-999e-788d79379858], does not exist path=[/infra/domains/default/groups/2c341293-b79a-440b-999e-788d79379858]."\n}' [ 1275.212713] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c341293-b79a-440b-999e-788d79379858 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/2c341293-b79a-440b-999e-788d79379858 [ 1275.212806] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1275.252854] env[69920]: INFO networking_nsxv3.common.synchronization [req-e0f50abd-47d6-4fe6-be3e-df5e56178d3e req-2af22827-e0c3-4fef-a324-04a51e1d6d67 tempest-ServerRescueTestJSONUnderV235-236466356 tempest-ServerRescueTestJSONUnderV235-236466356-project-member] Enqueued Resource ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 with Priority: HIGHEST for action security_group_members [ 1275.253387] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 with Priority: HIGHEST for action security_group_members [ 1275.253685] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdb3779b-8847-4ca1-8d11-e82bb873c989 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.254108] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.259246] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.259395] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.259449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.259682] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.261085] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.261369] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.261483] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.261580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.261761] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.261848] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.262029] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.262129] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.262183] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.262326] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.262393] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.262478] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c341293-b79a-440b-999e-788d79379858 is going to be created. [ 1275.279242] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/2c341293-b79a-440b-999e-788d79379858], does not exist path=[/infra/domains/default/groups/2c341293-b79a-440b-999e-788d79379858]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/2c341293-b79a-440b-999e-788d79379858 [ 1275.279242] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c341293-b79a-440b-999e-788d79379858" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.279426] env[69920]: Traceback (most recent call last): [ 1275.279426] env[69920]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1275.279426] env[69920]: return func(*args, **kwargs) [ 1275.279589] env[69920]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1275.279589] env[69920]: res.raise_for_status() [ 1275.279589] env[69920]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1275.279589] env[69920]: raise HTTPError(http_error_msg, response=self) [ 1275.279589] env[69920]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/2c341293-b79a-440b-999e-788d79379858 [ 1275.279589] env[69920]: During handling of the above exception, another exception occurred: [ 1275.279589] env[69920]: Traceback (most recent call last): [ 1275.279589] env[69920]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1275.279589] env[69920]: listener.cb(fileno) [ 1275.279589] env[69920]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1275.279589] env[69920]: result = function(*args, **kwargs) [ 1275.279589] env[69920]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1275.279589] env[69920]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1275.279589] env[69920]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1275.279589] env[69920]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1275.279589] env[69920]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1275.279589] env[69920]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1275.279589] env[69920]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1275.279589] env[69920]: res.raise_for_status() [ 1275.279589] env[69920]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1275.279589] env[69920]: raise HTTPError(http_error_msg, response=self) [ 1275.279589] env[69920]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/2c341293-b79a-440b-999e-788d79379858 [ 1275.279589] env[69920]: Removing descriptor: 74 [ 1276.168811] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 in Status: SUCCESS [ 1276.169094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.169206] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.169421] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.169640] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.169788] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.169837] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.169975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.170067] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.170162] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdb3779b-8847-4ca1-8d11-e82bb873c989',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.665521] env[69920]: INFO networking_nsxv3.common.synchronization [req-7bd81932-d7eb-4e78-8cd7-1ac18981c605 req-cfaab531-e833-4a77-be20-0a554e7e938b tempest-ListServerFiltersTestJSON-532103941 tempest-ListServerFiltersTestJSON-532103941-project-member] Enqueued Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_members [ 1276.666179] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGHEST for action security_group_members [ 1276.666592] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-60c7134e-2e86-428f-b754-45baab82ae62 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.666754] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.666811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.668411] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.668615] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.668774] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.668849] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.669089] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.669194] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.669332] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.672013] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.672130] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.672473] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.672473] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.692703] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.693381] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.693501] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.693574] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.693761] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.693842] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.693928] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 is going to be updated. [ 1276.721346] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.721597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.721597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.721750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.721890] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.730915] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 in Status: IN_PROGRESS for 2s [ 1277.172229] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.172607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.172607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.172762] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.203765] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.204105] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.204255] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.204255] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.204434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.204556] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.204608] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60c7134e-2e86-428f-b754-45baab82ae62 is going to be updated. [ 1277.231718] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.231956] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.231956] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.232242] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.232616] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.249625] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60c7134e-2e86-428f-b754-45baab82ae62 in Status: IN_PROGRESS for 2s [ 1278.741071] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 in Status: SUCCESS [ 1278.741436] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 deletion is rescheduled due to dependency. [ 1278.741436] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.741586] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.741818] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.742123] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.742305] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.742438] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.742690] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.742839] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.743031] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdb3779b-8847-4ca1-8d11-e82bb873c989',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.246297] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.246480] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.246570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.246766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.246860] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.247079] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.247184] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.247248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.247406] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.247488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.247599] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 is going to be updated. [ 1279.262740] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60c7134e-2e86-428f-b754-45baab82ae62 in Status: SUCCESS [ 1279.262986] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60c7134e-2e86-428f-b754-45baab82ae62 deletion is rescheduled due to dependency. [ 1279.263048] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.277220] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.277434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.277434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.277681] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.277825] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.287895] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 in Status: IN_PROGRESS for 2s [ 1279.687169] env[69920]: INFO networking_nsxv3.common.synchronization [req-b928d11d-e8df-436e-af78-38a87c8cb1d8 req-65d8e0ed-52dd-4797-a7be-df63a5f39d0b tempest-AttachVolumeNegativeTest-700673554 tempest-AttachVolumeNegativeTest-700673554-project-member] Enqueued Resource ID: f396ecc9-2832-4971-bf67-f8c7289f9916 with Priority: HIGHEST for action security_group_members [ 1279.687169] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f396ecc9-2832-4971-bf67-f8c7289f9916 with Priority: HIGHEST for action security_group_members [ 1279.687169] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f396ecc9-2832-4971-bf67-f8c7289f9916 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.687169] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.687169] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.687169] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.687525] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.687525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.687525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.687690] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.687784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.687896] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f396ecc9-2832-4971-bf67-f8c7289f9916',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.749033] env[69920]: INFO networking_nsxv3.common.synchronization [req-d06c8ac9-2a4d-4ace-b6bb-7374368ef9a3 req-369bfdb3-6cf4-4a0c-a34a-9e0d3bfb38b6 tempest-ServersTestJSON-738065696 tempest-ServersTestJSON-738065696-project-member] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1279.749640] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1279.750369] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.750369] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.750369] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.750619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.750619] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.750717] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.750760] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.750909] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.750999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.751124] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.046273] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-21 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.046471] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.046590] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.046877] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.047188] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.047350] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.047633] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.047816] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.047969] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.048210] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1280.048338] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1280.048451] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1280.048560] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1280.048671] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1280.048777] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1280.048922] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1280.069830] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1280.070189] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1280.070301] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1280.070491] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-21" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.070862] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-ee634287-1d03-4e08-bdc7-07ab41963c1c taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.071208] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-ee634287-1d03-4e08-bdc7-07ab41963c1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.071278] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-ee634287-1d03-4e08-bdc7-07ab41963c1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.071637] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-ee634287-1d03-4e08-bdc7-07ab41963c1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.071816] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee634287-1d03-4e08-bdc7-07ab41963c1c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.189701] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.190037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.190037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.190303] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.219167] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.219438] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.219562] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.219669] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.219879] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.219968] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.220075] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f396ecc9-2832-4971-bf67-f8c7289f9916 is going to be updated. [ 1280.249099] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.249343] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.249497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.249842] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.250016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.252860] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.258849] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f396ecc9-2832-4971-bf67-f8c7289f9916 in Status: IN_PROGRESS for 2s [ 1280.574771] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.575094] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.575241] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.575530] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.575689] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.576286] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port ee634287-1d03-4e08-bdc7-07ab41963c1c not found, creating... [ 1280.576665] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.576850] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.576979] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.577249] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.577400] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.577748] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.577911] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.578048] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.578280] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.578426] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.578576] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: ee634287-1d03-4e08-bdc7-07ab41963c1c is going to be created. [ 1280.603365] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.603365] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.603365] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.603365] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.603365] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.603365] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-ee634287-1d03-4e08-bdc7-07ab41963c1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.755369] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.258599] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.258599] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.258599] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.258599] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.258599] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.258599] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1281.288754] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.288901] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.288984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.289221] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.289871] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.302146] env[69920]: INFO networking_nsxv3.common.synchronization [req-d06c8ac9-2a4d-4ace-b6bb-7374368ef9a3 req-59407d3e-aad4-4655-8a1f-1d5265cb3753 service nova] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_rules [ 1281.302223] env[69920]: INFO networking_nsxv3.common.synchronization [req-d06c8ac9-2a4d-4ace-b6bb-7374368ef9a3 req-59407d3e-aad4-4655-8a1f-1d5265cb3753 service nova] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1281.302368] env[69920]: INFO networking_nsxv3.common.synchronization [req-d06c8ac9-2a4d-4ace-b6bb-7374368ef9a3 req-59407d3e-aad4-4655-8a1f-1d5265cb3753 service nova] Enqueued Resource ID: ee634287-1d03-4e08-bdc7-07ab41963c1c with Priority: HIGHEST for action port [ 1281.303432] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1281.304134] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 in Status: SUCCESS [ 1281.304489] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 deletion is rescheduled due to dependency. [ 1281.304489] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.305437] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_rules [ 1281.305592] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1281.305667] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee634287-1d03-4e08-bdc7-07ab41963c1c with Priority: HIGHEST for action port [ 1281.305815] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.306029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.306209] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.306320] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.306385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.306539] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.306623] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.306708] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.306800] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fdb3779b-8847-4ca1-8d11-e82bb873c989',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.307702] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.307817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.307886] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.308053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.308132] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.308870] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.308964] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.309159] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee634287-1d03-4e08-bdc7-07ab41963c1c taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.309249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee634287-1d03-4e08-bdc7-07ab41963c1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.309306] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee634287-1d03-4e08-bdc7-07ab41963c1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.309455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee634287-1d03-4e08-bdc7-07ab41963c1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.309700] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee634287-1d03-4e08-bdc7-07ab41963c1c',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.310139] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.310301] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.310448] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.310544] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.310612] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.310744] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.310825] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.311283] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fdb3779b-8847-4ca1-8d11-e82bb873c989',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.813207] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.813547] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.813547] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee634287-1d03-4e08-bdc7-07ab41963c1c with status ACTIVE [ 1281.813684] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.813786] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.813849] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.814100] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.814202] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.814366] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.814460] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.814521] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.814681] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.814759] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.814939] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.815049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.815123] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.815273] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.815349] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.815435] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee634287-1d03-4e08-bdc7-07ab41963c1c is going to be updated. [ 1281.816548] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdb3779b-8847-4ca1-8d11-e82bb873c989 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.816648] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.816872] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.816969] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.817051] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.817230] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.817311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.817474] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.817609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.817653] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.817790] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.817865] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.817949] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 is going to be updated. [ 1281.848916] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.849216] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.849216] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.849379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.849522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.849724] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee634287-1d03-4e08-bdc7-07ab41963c1c" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.925226] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.925418] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.925488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.925661] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.925805] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.937578] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 in Status: IN_PROGRESS for 2s [ 1282.267965] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f396ecc9-2832-4971-bf67-f8c7289f9916 in Status: SUCCESS [ 1282.268177] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f396ecc9-2832-4971-bf67-f8c7289f9916 deletion is rescheduled due to dependency. [ 1282.268292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.313639] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1283.313967] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.313967] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.314089] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.314218] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.314330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.314392] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.314539] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.314631] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.314713] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.624708] env[69920]: INFO networking_nsxv3.common.synchronization [req-dcba227c-2475-40d4-a108-cddbebbf64da req-e2375dbd-65b4-4fe2-8904-f3f310699b6f tempest-ServerActionsTestOtherB-54229569 tempest-ServerActionsTestOtherB-54229569-project-member] Enqueued Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_members [ 1283.624708] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_members [ 1283.624708] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.624708] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.624708] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.625029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.625508] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.625508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.625508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.625508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.625702] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.625817] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.822140] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.947014] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 in Status: SUCCESS [ 1283.947209] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 deletion is rescheduled due to dependency. [ 1283.947352] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.947487] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.947769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.947976] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.948141] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.948211] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.948375] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.948456] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.948539] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.948697] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fdb3779b-8847-4ca1-8d11-e82bb873c989 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.948872] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.948951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.949312] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.949512] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.949707] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.950381] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.950381] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.950381] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.950381] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.950381] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fdb3779b-8847-4ca1-8d11-e82bb873c989',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.129026] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.129026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.129026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.129026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.151280] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.151523] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.151645] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.151710] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.151933] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.153128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.153266] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b is going to be updated. [ 1284.182100] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.182298] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.182420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.182564] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.182729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.193105] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: IN_PROGRESS for 2s [ 1284.327903] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.452228] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fdb3779b-8847-4ca1-8d11-e82bb873c989: rpc.has_security_group_logging(os_id): False [ 1284.473036] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.473234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.473309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.473530] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.473617] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.473831] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.473947] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.474020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.474175] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.474248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.474433] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.474521] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.474581] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.474727] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.474806] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.474970] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.475080] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.475497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.475497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.475497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.475497] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 is going to be updated. [ 1284.533410] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.533563] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.533658] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.533838] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.534082] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.547319] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 in Status: IN_PROGRESS for 2s [ 1284.826402] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.826572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.826646] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.826856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.826999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.827173] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1284.855101] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.855259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.855323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.855534] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.855693] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.866516] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1285.824378] env[69920]: INFO networking_nsxv3.common.synchronization [None req-07bb2ea4-5ad4-48b0-ae60-13951778095a None None] Enqueued Resource ID: ae3aa3f8-daed-4981-9bc8-fad286ce7b58 with Priority: HIGHEST for action port [ 1285.824656] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae3aa3f8-daed-4981-9bc8-fad286ce7b58 with Priority: HIGHEST for action port [ 1285.825200] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae3aa3f8-daed-4981-9bc8-fad286ce7b58 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.825324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae3aa3f8-daed-4981-9bc8-fad286ce7b58" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.825394] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae3aa3f8-daed-4981-9bc8-fad286ce7b58" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.825869] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae3aa3f8-daed-4981-9bc8-fad286ce7b58" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.825991] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae3aa3f8-daed-4981-9bc8-fad286ce7b58',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.214877] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: SUCCESS [ 1286.214948] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b deletion is rescheduled due to dependency. [ 1286.215194] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.328053] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae3aa3f8-daed-4981-9bc8-fad286ce7b58 [ 1286.328348] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.328529] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.328678] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.328952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.329132] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.329258] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae3aa3f8-daed-4981-9bc8-fad286ce7b58 already deleted. [ 1286.329484] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae3aa3f8-daed-4981-9bc8-fad286ce7b58" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.399522] env[69920]: INFO networking_nsxv3.common.synchronization [None req-d0ad79c6-4705-4a30-9a5e-8bdc74b14727 tempest-ServerActionsTestOtherA-296658517 tempest-ServerActionsTestOtherA-296658517-project-member] Enqueued Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGHEST for action security_group_rules [ 1286.399935] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGHEST for action security_group_rules [ 1286.401958] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21459423-ae1a-4ef3-b1fd-549e38f9136d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.401958] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.401958] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.401958] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.401958] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.484641] env[69920]: INFO networking_nsxv3.common.synchronization [None req-2dde7942-c0c5-43de-a617-5fea08948298 tempest-ServerActionsTestOtherA-296658517 tempest-ServerActionsTestOtherA-296658517-project-member] Enqueued Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGHEST for action security_group_rules [ 1286.485168] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGHEST for action security_group_rules [ 1286.485462] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21459423-ae1a-4ef3-b1fd-549e38f9136d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.485558] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.561027] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 in Status: SUCCESS [ 1286.561027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.561319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.561541] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.561706] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fdb3779b-8847-4ca1-8d11-e82bb873c989',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.875803] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1286.876114] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.876216] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.876407] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.876589] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.876703] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.876761] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.876910] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.876991] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.877105] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.877195] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.923180] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.923180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.923180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.923180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.923180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.923180] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d already deleted. [ 1286.923180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.923180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.923180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.923180] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.083240] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.083434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.083434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.087101] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.087297] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.087408] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fdb3779b-8847-4ca1-8d11-e82bb873c989 is going to be deleted. [ 1287.136162] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.136335] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.136384] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.136575] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.136658] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.136772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fdb3779b-8847-4ca1-8d11-e82bb873c989" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.380325] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.380507] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.380565] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.380815] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.381085] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.381209] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.381294] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.381517] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.381661] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.381780] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.382025] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.382154] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.382284] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.382460] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.382653] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.382796] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.382877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.383260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.383396] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.383517] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.383673] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.447639] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.448169] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.448169] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.448270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.448395] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.448452] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d already deleted. [ 1287.448541] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.886212] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd313130-fb41-4c30-96a8-0facc1385d33: rpc.has_security_group_logging(os_id): False [ 1287.904035] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.904169] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.904245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.904463] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.925221] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.925474] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.925594] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.925663] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.925859] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.925940] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.926347] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.926347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.926347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.926521] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.926521] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.926695] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.926789] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.926851] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.926992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.927082] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.927216] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1287.948961] env[69920]: INFO networking_nsxv3.common.synchronization [None req-299d4c89-be8e-4591-a300-5708197b4a24 None None] Enqueued Resource ID: 64e00685-7b71-45e0-8c18-17043f79d987 with Priority: HIGHEST for action port [ 1287.948961] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64e00685-7b71-45e0-8c18-17043f79d987 with Priority: HIGHEST for action port [ 1287.948961] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-64e00685-7b71-45e0-8c18-17043f79d987 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.948961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64e00685-7b71-45e0-8c18-17043f79d987" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.948961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64e00685-7b71-45e0-8c18-17043f79d987" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.948961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64e00685-7b71-45e0-8c18-17043f79d987" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.948961] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64e00685-7b71-45e0-8c18-17043f79d987',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.996146] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.996674] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.997136] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.997609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.999820] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.016487] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1288.450906] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64e00685-7b71-45e0-8c18-17043f79d987 [ 1288.451172] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.451320] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.451409] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.451613] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.451698] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.451795] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64e00685-7b71-45e0-8c18-17043f79d987 already deleted. [ 1288.451872] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64e00685-7b71-45e0-8c18-17043f79d987" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.035689] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1290.035689] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.466328] env[69920]: INFO networking_nsxv3.common.synchronization [req-96b304ee-8117-4198-8226-8d2804340ea2 req-04a261ce-2fb3-45e5-b243-0a713521d1aa tempest-ServerActionsTestOtherA-296658517 tempest-ServerActionsTestOtherA-296658517-project-member] Enqueued Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGHEST for action security_group_members [ 1292.466722] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGHEST for action security_group_members [ 1292.467039] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-21459423-ae1a-4ef3-b1fd-549e38f9136d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.467166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.467237] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.467487] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.467678] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.467841] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.467841] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.467970] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.468242] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.468345] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.774305] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-26 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.774523] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.774639] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.775326] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.775612] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.775830] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.775937] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.776402] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.776402] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.776625] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1292.776752] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1292.776870] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1292.776985] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1292.777115] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1292.777228] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1292.777368] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1292.798170] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1292.798170] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1292.798170] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1292.798170] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.798339] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-cefb857a-0190-4924-a605-749a4858cef2 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.798429] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-cefb857a-0190-4924-a605-749a4858cef2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.798562] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-cefb857a-0190-4924-a605-749a4858cef2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.798893] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-cefb857a-0190-4924-a605-749a4858cef2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.799047] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cefb857a-0190-4924-a605-749a4858cef2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.970520] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.970802] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.970802] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.971060] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.971219] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.971354] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.971442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.971512] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.971651] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.971736] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.971819] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d already deleted. [ 1292.971900] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.304048] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.304347] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.304423] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.304696] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.304850] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.305017] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port cefb857a-0190-4924-a605-749a4858cef2 not found, creating... [ 1293.305285] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.305445] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.305567] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.305813] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.305938] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.306236] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.306395] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.306515] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.306723] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.306861] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.307015] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: cefb857a-0190-4924-a605-749a4858cef2 is going to be created. [ 1293.326848] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.327091] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.327223] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.327454] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.327686] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.327908] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-cefb857a-0190-4924-a605-749a4858cef2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.189022] env[69920]: INFO networking_nsxv3.common.synchronization [req-96b304ee-8117-4198-8226-8d2804340ea2 req-e88c838d-7282-4fe8-8cbb-ee4da4cfd88d service nova] Enqueued Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGHEST for action security_group_rules [ 1294.189022] env[69920]: INFO networking_nsxv3.common.synchronization [req-96b304ee-8117-4198-8226-8d2804340ea2 req-e88c838d-7282-4fe8-8cbb-ee4da4cfd88d service nova] Enqueued Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGHEST for action security_group_members [ 1294.189022] env[69920]: INFO networking_nsxv3.common.synchronization [req-96b304ee-8117-4198-8226-8d2804340ea2 req-e88c838d-7282-4fe8-8cbb-ee4da4cfd88d service nova] Enqueued Resource ID: cefb857a-0190-4924-a605-749a4858cef2 with Priority: HIGHEST for action port [ 1294.189654] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGHEST for action security_group_rules [ 1294.189862] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGHEST for action security_group_members [ 1294.194117] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cefb857a-0190-4924-a605-749a4858cef2 with Priority: HIGHEST for action port [ 1294.194802] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21459423-ae1a-4ef3-b1fd-549e38f9136d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.194802] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.195060] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.195318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.195479] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.200024] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-21459423-ae1a-4ef3-b1fd-549e38f9136d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.200024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.200024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.200024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.200024] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.200024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.200024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.200024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.200024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.200024] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.200024] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-cefb857a-0190-4924-a605-749a4858cef2 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.200024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cefb857a-0190-4924-a605-749a4858cef2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.200024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cefb857a-0190-4924-a605-749a4858cef2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.200024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cefb857a-0190-4924-a605-749a4858cef2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.200024] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cefb857a-0190-4924-a605-749a4858cef2',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.521584] env[69920]: INFO networking_nsxv3.common.synchronization [req-c6ab4346-da19-4625-bb22-df2e235ddcc9 req-fc3610eb-6b53-46be-b784-648e92c9cad5 tempest-ServerActionsTestOtherB-54229569 tempest-ServerActionsTestOtherB-54229569-project-member] Enqueued Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_members [ 1294.522066] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_members [ 1294.522392] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.522526] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.522597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.522830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.523282] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.523282] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.523282] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.523505] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.523505] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.523578] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.702265] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.704964] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-21459423-ae1a-4ef3-b1fd-549e38f9136d taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.704964] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.704964] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cefb857a-0190-4924-a605-749a4858cef2 with status ACTIVE [ 1294.704964] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.704964] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.704964] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.704964] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.704964] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.704964] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.704964] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.704964] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.705543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.705668] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.705889] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.706025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.706178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.706290] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.706422] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.706552] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cefb857a-0190-4924-a605-749a4858cef2 is going to be updated. [ 1294.732112] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.732112] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.732112] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.732112] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.732112] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.732112] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cefb857a-0190-4924-a605-749a4858cef2" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.941086] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.942576] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-690" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.942576] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-690" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.942576] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-690" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.942576] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.942576] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.942576] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.942976] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.943184] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.943443] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1294.943632] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1294.943783] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1294.943920] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1294.944109] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1294.944289] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1294.945093] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1294.966667] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1294.966868] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1294.967060] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1294.967255] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-690" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.967775] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-cdd401dc-1a64-40f2-931e-f19611bb56d3 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.968039] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-cdd401dc-1a64-40f2-931e-f19611bb56d3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.968398] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-cdd401dc-1a64-40f2-931e-f19611bb56d3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.968748] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-cdd401dc-1a64-40f2-931e-f19611bb56d3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.968903] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdd401dc-1a64-40f2-931e-f19611bb56d3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.002899] env[69920]: INFO networking_nsxv3.common.synchronization [req-1e99f228-fd69-4407-9846-391aaa8e988a req-b0528450-a3dc-4edc-b8e9-10bcbb6f0368 tempest-ServersTestJSON-738065696 tempest-ServersTestJSON-738065696-project-member] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1295.003917] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1295.003917] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.004117] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.004502] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.004884] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.005097] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.005206] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.005265] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.005431] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.005620] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.005725] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.025939] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.026105] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.026181] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.026394] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.026488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.026679] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.026778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.026845] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.027007] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.027097] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.027188] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b is going to be updated. [ 1295.053764] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.053930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.053976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.055347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.055347] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.064948] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: IN_PROGRESS for 2s [ 1295.205774] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.472292] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.472535] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.472729] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.473076] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.473274] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.473432] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port cdd401dc-1a64-40f2-931e-f19611bb56d3 not found, creating... [ 1295.473748] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.473935] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.474091] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.474363] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.474705] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.475144] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.475609] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.475609] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.475815] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.475976] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.476219] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: cdd401dc-1a64-40f2-931e-f19611bb56d3 is going to be created. [ 1295.505121] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.505121] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.505121] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.505121] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.505121] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.505121] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-cdd401dc-1a64-40f2-931e-f19611bb56d3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.508430] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.708464] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.708658] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.708728] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.708977] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.709089] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.709169] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d is going to be created. [ 1295.732236] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.732412] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.732470] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.732672] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.732830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.742772] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d in Status: UNINITIALIZED for 2s [ 1295.780820] env[69920]: INFO networking_nsxv3.common.synchronization [None req-07ffa8d6-3bc8-4818-a28e-e7373adbd6c7 tempest-ServerActionsTestJSON-2022006223 tempest-ServerActionsTestJSON-2022006223-project-member] Enqueued Resource ID: 25d6107d-095d-4250-920f-5b89f0d9b75b with Priority: HIGHEST for action security_group_rules [ 1295.781357] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25d6107d-095d-4250-920f-5b89f0d9b75b with Priority: HIGHEST for action security_group_rules [ 1295.781660] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25d6107d-095d-4250-920f-5b89f0d9b75b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.781803] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.781871] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.782145] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.782233] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25d6107d-095d-4250-920f-5b89f0d9b75b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.900565] env[69920]: INFO networking_nsxv3.common.synchronization [None req-16058746-c11f-4f7c-aaea-11ac92b12f26 tempest-ServerActionsTestJSON-2022006223 tempest-ServerActionsTestJSON-2022006223-project-member] Enqueued Resource ID: 25d6107d-095d-4250-920f-5b89f0d9b75b with Priority: HIGHEST for action security_group_rules [ 1295.901135] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25d6107d-095d-4250-920f-5b89f0d9b75b with Priority: HIGHEST for action security_group_rules [ 1295.901438] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25d6107d-095d-4250-920f-5b89f0d9b75b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.901540] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.010525] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.220472] env[69920]: INFO networking_nsxv3.common.synchronization [req-c6ab4346-da19-4625-bb22-df2e235ddcc9 req-ace549a9-14db-42dc-8e43-af8521db80b5 service nova] Enqueued Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_rules [ 1296.220900] env[69920]: INFO networking_nsxv3.common.synchronization [req-c6ab4346-da19-4625-bb22-df2e235ddcc9 req-ace549a9-14db-42dc-8e43-af8521db80b5 service nova] Enqueued Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_members [ 1296.220985] env[69920]: INFO networking_nsxv3.common.synchronization [req-c6ab4346-da19-4625-bb22-df2e235ddcc9 req-ace549a9-14db-42dc-8e43-af8521db80b5 service nova] Enqueued Resource ID: cdd401dc-1a64-40f2-931e-f19611bb56d3 with Priority: HIGHEST for action port [ 1296.221612] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_rules [ 1296.221820] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_members [ 1296.222117] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdd401dc-1a64-40f2-931e-f19611bb56d3 with Priority: HIGHEST for action port [ 1296.222212] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.222317] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.222374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.222573] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.222657] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.223567] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.223656] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.223801] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdd401dc-1a64-40f2-931e-f19611bb56d3 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.224041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdd401dc-1a64-40f2-931e-f19611bb56d3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.224041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdd401dc-1a64-40f2-931e-f19611bb56d3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.224245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdd401dc-1a64-40f2-931e-f19611bb56d3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.224245] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdd401dc-1a64-40f2-931e-f19611bb56d3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.305387] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.305555] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.305667] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.305964] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.305964] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.306078] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25d6107d-095d-4250-920f-5b89f0d9b75b already deleted. [ 1296.306128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.306285] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.306480] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.306544] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25d6107d-095d-4250-920f-5b89f0d9b75b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.513270] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.513421] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.513547] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.513740] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.513850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.514010] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1296.556029] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.556186] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.556248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.556477] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.556765] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.566181] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1296.729425] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.729425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.729425] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cdd401dc-1a64-40f2-931e-f19611bb56d3 with status ACTIVE [ 1296.729425] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.729425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.729425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.729425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.729425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.729425] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.729425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.729425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.729425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.729425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.729425] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.730111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.730111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.730111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.730111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.730111] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cdd401dc-1a64-40f2-931e-f19611bb56d3 is going to be updated. [ 1296.749053] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.749248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.749248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.749397] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.749619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.750627] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdd401dc-1a64-40f2-931e-f19611bb56d3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.830786] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.830937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.831025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.831249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.831344] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.831439] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25d6107d-095d-4250-920f-5b89f0d9b75b already deleted. [ 1296.831524] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.075224] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: SUCCESS [ 1297.075402] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b deletion is rescheduled due to dependency. [ 1297.075522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.075766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.075903] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.076102] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.076216] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.076286] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.076434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.076516] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.076609] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.235556] env[69920]: INFO networking_nsxv3.common.synchronization [req-bc7c6606-401f-400a-a535-7c975c2f64a5 req-f1683298-fd55-4406-b06b-66610cb5c994 tempest-AttachVolumeShelveTestJSON-389172843 tempest-AttachVolumeShelveTestJSON-389172843-project-member] Enqueued Resource ID: fab6b45f-3ae6-4550-ba52-182144930713 with Priority: HIGHEST for action security_group_members [ 1297.236145] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab6b45f-3ae6-4550-ba52-182144930713 with Priority: HIGHEST for action security_group_members [ 1297.236484] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab6b45f-3ae6-4550-ba52-182144930713 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.236608] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.236675] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.236877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.237036] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.237135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.237197] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.237341] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.237425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.237515] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab6b45f-3ae6-4550-ba52-182144930713',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.579067] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.740037] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.740243] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.740243] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.740435] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.755596] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d in Status: SUCCESS [ 1297.755806] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.755968] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.756207] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.756408] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.756516] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.756581] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.756736] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.756820] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.756906] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.756995] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.761710] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.761834] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.761911] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.763638] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.763638] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.763638] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.763638] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab6b45f-3ae6-4550-ba52-182144930713 is going to be updated. [ 1297.799028] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.799028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.799028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.799028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.799028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.811860] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab6b45f-3ae6-4550-ba52-182144930713 in Status: IN_PROGRESS for 2s [ 1298.081530] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.259696] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.574829] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1298.575080] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.583638] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.583881] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.583955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.584183] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.584275] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.584374] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b is going to be updated. [ 1298.612552] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.612552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.612552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.612552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.612552] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.622671] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: IN_PROGRESS for 2s [ 1298.761320] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21459423-ae1a-4ef3-b1fd-549e38f9136d: rpc.has_security_group_logging(os_id): False [ 1298.788267] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.788406] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.788451] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.788641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.788733] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.789114] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.789250] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.789250] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.789456] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.789456] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.789520] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d is going to be created. [ 1298.856617] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.856808] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.856897] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.857312] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.857442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.877455] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d in Status: IN_PROGRESS for 2s [ 1299.821910] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab6b45f-3ae6-4550-ba52-182144930713 in Status: SUCCESS [ 1299.822289] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab6b45f-3ae6-4550-ba52-182144930713 deletion is rescheduled due to dependency. [ 1299.822289] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.636050] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: SUCCESS [ 1300.636050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.636270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.636489] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.636767] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.636988] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.637205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.637419] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.637508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.637689] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.637822] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.889748] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d in Status: SUCCESS [ 1300.890188] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.140579] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.399197] env[69920]: INFO networking_nsxv3.common.synchronization [req-e3c06154-7fe3-45e5-8760-f7ded9bb8043 req-403c7e88-84f6-4aa3-ac95-60b4481491e8 tempest-ServersTestJSON-738065696 tempest-ServersTestJSON-738065696-project-member] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1301.399197] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGHEST for action security_group_members [ 1301.399197] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.399197] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.399197] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.399764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.402098] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.402098] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.402098] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.402098] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.402098] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.402098] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.509658] env[69920]: INFO networking_nsxv3.common.synchronization [req-21cc4896-13d2-40d6-a93b-ff5b2195193b req-33108ab8-1f78-4912-a9ea-946d03e9ad29 tempest-ServerActionsTestJSON-2022006223 tempest-ServerActionsTestJSON-2022006223-project-member] Enqueued Resource ID: 25d6107d-095d-4250-920f-5b89f0d9b75b with Priority: HIGHEST for action security_group_members [ 1301.510799] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25d6107d-095d-4250-920f-5b89f0d9b75b with Priority: HIGHEST for action security_group_members [ 1301.510799] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-25d6107d-095d-4250-920f-5b89f0d9b75b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.510799] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.511160] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.511160] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.511555] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.511555] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.511555] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.511909] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.511909] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.512054] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25d6107d-095d-4250-920f-5b89f0d9b75b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.644659] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ae58702-5520-4afd-abbd-064c34515d9b: rpc.has_security_group_logging(os_id): False [ 1301.667039] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.667039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.667039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.667039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.667039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.667039] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.667039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.667039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.667039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.667039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.667039] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b is going to be updated. [ 1301.726344] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.726344] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.726344] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.726344] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.726344] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.739814] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: IN_PROGRESS for 2s [ 1301.816291] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-373 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.816291] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-373" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.816478] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-373" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.817036] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-373" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.817378] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.817568] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.817695] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.818030] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.818106] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.818332] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1301.818454] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1301.818571] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1301.818685] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1301.818803] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1301.818914] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1301.819068] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1301.841954] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1301.842144] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1301.842290] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1301.842471] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-373" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.842800] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-212263f4-2ce1-4c5f-a203-887ea0b690a0 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.842976] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-212263f4-2ce1-4c5f-a203-887ea0b690a0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.843122] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-212263f4-2ce1-4c5f-a203-887ea0b690a0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.843478] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-212263f4-2ce1-4c5f-a203-887ea0b690a0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.843596] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('212263f4-2ce1-4c5f-a203-887ea0b690a0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.904075] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.904075] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.904075] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.904075] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.904075] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.904880] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.904880] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.904880] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.904880] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.904880] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.904880] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be updated. [ 1301.947161] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.947405] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.947555] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.947909] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.948107] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.958173] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: IN_PROGRESS for 2s [ 1302.016138] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.016138] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.016138] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.016138] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.016138] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.016138] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.016138] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.016138] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.016138] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.016138] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.016138] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25d6107d-095d-4250-920f-5b89f0d9b75b already deleted. [ 1302.016138] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.346760] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.347346] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.347346] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.347695] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.347978] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.348179] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 212263f4-2ce1-4c5f-a203-887ea0b690a0 not found, creating... [ 1302.348780] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.349053] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.349248] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.349576] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.349794] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.350276] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.350475] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.350659] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.350973] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.351200] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.351411] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 212263f4-2ce1-4c5f-a203-887ea0b690a0 is going to be created. [ 1302.372096] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.372402] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.372484] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.372776] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.375070] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.375070] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-212263f4-2ce1-4c5f-a203-887ea0b690a0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.136024] env[69920]: INFO networking_nsxv3.common.synchronization [req-21cc4896-13d2-40d6-a93b-ff5b2195193b req-dff0590a-c1b8-4547-bfd2-6e38991da95a service nova] Enqueued Resource ID: 25d6107d-095d-4250-920f-5b89f0d9b75b with Priority: HIGHEST for action security_group_rules [ 1303.136024] env[69920]: INFO networking_nsxv3.common.synchronization [req-21cc4896-13d2-40d6-a93b-ff5b2195193b req-dff0590a-c1b8-4547-bfd2-6e38991da95a service nova] Enqueued Resource ID: 25d6107d-095d-4250-920f-5b89f0d9b75b with Priority: HIGHEST for action security_group_members [ 1303.136024] env[69920]: INFO networking_nsxv3.common.synchronization [req-21cc4896-13d2-40d6-a93b-ff5b2195193b req-dff0590a-c1b8-4547-bfd2-6e38991da95a service nova] Enqueued Resource ID: 212263f4-2ce1-4c5f-a203-887ea0b690a0 with Priority: HIGHEST for action port [ 1303.136024] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25d6107d-095d-4250-920f-5b89f0d9b75b with Priority: HIGHEST for action security_group_rules [ 1303.136024] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25d6107d-095d-4250-920f-5b89f0d9b75b with Priority: HIGHEST for action security_group_members [ 1303.136024] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 212263f4-2ce1-4c5f-a203-887ea0b690a0 with Priority: HIGHEST for action port [ 1303.136024] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25d6107d-095d-4250-920f-5b89f0d9b75b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.136024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.136024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.136024] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.136024] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25d6107d-095d-4250-920f-5b89f0d9b75b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.136626] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-25d6107d-095d-4250-920f-5b89f0d9b75b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.136626] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.136626] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.136626] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.137015] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.137015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.137015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.137131] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.137566] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.137686] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25d6107d-095d-4250-920f-5b89f0d9b75b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.139613] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-212263f4-2ce1-4c5f-a203-887ea0b690a0 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.139613] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-212263f4-2ce1-4c5f-a203-887ea0b690a0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.139613] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-212263f4-2ce1-4c5f-a203-887ea0b690a0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.139613] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-212263f4-2ce1-4c5f-a203-887ea0b690a0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.139613] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('212263f4-2ce1-4c5f-a203-887ea0b690a0',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.319545] env[69920]: INFO networking_nsxv3.common.synchronization [req-d54f815b-c114-499a-b8f3-4cda02c8007e req-e5d9bbcf-f8a9-40db-a39a-ac5a65971ac7 tempest-ServerRescueNegativeTestJSON-1943285071 tempest-ServerRescueNegativeTestJSON-1943285071-project-member] Enqueued Resource ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 with Priority: HIGHEST for action security_group_members [ 1303.319666] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 with Priority: HIGHEST for action security_group_members [ 1303.320025] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-21b36777-ea5b-4b29-980a-dc95fc42eb85 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.320179] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.320331] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.320541] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.320699] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.320793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.320891] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.321079] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.321165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.321235] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21b36777-ea5b-4b29-980a-dc95fc42eb85',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.642118] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-25d6107d-095d-4250-920f-5b89f0d9b75b taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.642118] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.642118] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25d6107d-095d-4250-920f-5b89f0d9b75b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.642118] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 212263f4-2ce1-4c5f-a203-887ea0b690a0 with status ACTIVE [ 1303.642430] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.642430] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.642430] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.642604] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.644364] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.644364] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.644364] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.644364] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.644364] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.644364] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.644364] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.644364] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.644364] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.644364] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.644364] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.644364] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 212263f4-2ce1-4c5f-a203-887ea0b690a0 is going to be updated. [ 1303.665558] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.665877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.666111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.666570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.666740] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.666905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-212263f4-2ce1-4c5f-a203-887ea0b690a0" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.776558] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: SUCCESS [ 1303.776816] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.824434] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.824641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.824641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.824892] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.850412] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.850702] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.850829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.850971] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.851214] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.851319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.851416] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 is going to be updated. [ 1303.886976] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.887205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.887443] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.887744] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.887986] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.901639] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 in Status: IN_PROGRESS for 2s [ 1303.971176] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd313130-fb41-4c30-96a8-0facc1385d33 in Status: SUCCESS [ 1303.971371] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 deletion is rescheduled due to dependency. [ 1303.971489] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.147212] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25d6107d-095d-4250-920f-5b89f0d9b75b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.654032] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.654223] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.654301] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.654587] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.654701] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.654812] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25d6107d-095d-4250-920f-5b89f0d9b75b is going to be created. [ 1304.703962] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.703962] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.703962] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.704289] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.704333] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.722991] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25d6107d-095d-4250-920f-5b89f0d9b75b in Status: UNINITIALIZED for 2s [ 1305.914226] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 in Status: SUCCESS [ 1305.914628] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 deletion is rescheduled due to dependency. [ 1305.914628] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.735902] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25d6107d-095d-4250-920f-5b89f0d9b75b in Status: SUCCESS [ 1306.735902] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.735902] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.736164] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.736360] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.736360] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.736524] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.736574] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.736662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.736747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.736835] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25d6107d-095d-4250-920f-5b89f0d9b75b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.242013] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25d6107d-095d-4250-920f-5b89f0d9b75b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.745397] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25d6107d-095d-4250-920f-5b89f0d9b75b: rpc.has_security_group_logging(os_id): False [ 1307.763060] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.763201] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.763270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.763484] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.763569] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.763801] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.763895] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.763964] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.764158] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.764232] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.764317] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25d6107d-095d-4250-920f-5b89f0d9b75b is going to be created. [ 1307.828115] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.828115] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.828115] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.828115] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.828115] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.838146] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25d6107d-095d-4250-920f-5b89f0d9b75b in Status: IN_PROGRESS for 2s [ 1308.324358] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1308.324358] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1309.851828] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25d6107d-095d-4250-920f-5b89f0d9b75b in Status: SUCCESS [ 1309.851828] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.321942] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1313.322372] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1313.814655] env[69920]: INFO networking_nsxv3.common.synchronization [req-85ca48ed-acc1-4fc8-a2c0-0b27f46bf088 req-6a93abbd-f5c0-4205-bb90-f384951bd12d tempest-ServerRescueNegativeTestJSON-1943285071 tempest-ServerRescueNegativeTestJSON-1943285071-project-member] Enqueued Resource ID: aca15fc8-3d94-4e24-9796-2477465c9437 with Priority: HIGHEST for action security_group_members [ 1313.815352] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aca15fc8-3d94-4e24-9796-2477465c9437 with Priority: HIGHEST for action security_group_members [ 1313.815668] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-aca15fc8-3d94-4e24-9796-2477465c9437 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.817029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.817029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.817497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.817802] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.818121] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.818906] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.818906] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.818906] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.818906] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aca15fc8-3d94-4e24-9796-2477465c9437',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.321081] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aca15fc8-3d94-4e24-9796-2477465c9437',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.822692] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aca15fc8-3d94-4e24-9796-2477465c9437',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.324926] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.325178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.325178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.325343] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.325434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.325530] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aca15fc8-3d94-4e24-9796-2477465c9437 is going to be updated. [ 1315.355696] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.356027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.356027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.356306] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.356524] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.366365] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aca15fc8-3d94-4e24-9796-2477465c9437 in Status: IN_PROGRESS for 2s [ 1317.377454] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aca15fc8-3d94-4e24-9796-2477465c9437 in Status: SUCCESS [ 1317.377916] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.816613] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1318.817103] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1320.477526] env[69920]: INFO networking_nsxv3.common.synchronization [req-c41a1434-adfa-4a1a-8a32-5a00fd1c9968 req-1e2ddccd-e709-4144-b625-4d103e6257a1 tempest-ServerRescueNegativeTestJSON-1943285071 tempest-ServerRescueNegativeTestJSON-1943285071-project-member] Enqueued Resource ID: aca15fc8-3d94-4e24-9796-2477465c9437 with Priority: HIGHEST for action security_group_members [ 1320.478097] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aca15fc8-3d94-4e24-9796-2477465c9437 with Priority: HIGHEST for action security_group_members [ 1320.479076] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-aca15fc8-3d94-4e24-9796-2477465c9437 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.479076] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.479076] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.479076] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.479076] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.479076] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.479076] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.479490] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.479490] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.479490] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aca15fc8-3d94-4e24-9796-2477465c9437',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.981704] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.982039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.982039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.982176] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.006056] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.006329] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.006471] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.006535] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.006711] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.006792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.006881] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aca15fc8-3d94-4e24-9796-2477465c9437 is going to be updated. [ 1321.034403] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.034647] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.034738] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.034969] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.035137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.043777] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aca15fc8-3d94-4e24-9796-2477465c9437 in Status: IN_PROGRESS for 2s [ 1321.178747] env[69920]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1321.178747] env[69920]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] NSXv3 Agent Agent loop - iteration:3 started [ 1323.053833] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aca15fc8-3d94-4e24-9796-2477465c9437 in Status: SUCCESS [ 1323.054278] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aca15fc8-3d94-4e24-9796-2477465c9437 deletion is rescheduled due to dependency. [ 1323.054278] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.478827] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1325.479221] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1327.120404] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.120825] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.120825] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.120936] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.120979] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.623456] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.126079] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.628332] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1328.628546] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1329.428667] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.429132] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.429132] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.429238] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.442295] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1329.443317] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.444168] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1329.480787] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.481064] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.481064] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.481228] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.496074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.496781] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1329.496866] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1329.496962] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1329.538344] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.538601] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.538601] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.538781] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.539852] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.540035] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1329.623272] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.623520] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.623520] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.623688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.624008] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.624287] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1329.706101] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.706409] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.706485] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.706780] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.707297] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.707722] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1329.707894] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'aca15fc8-3d94-4e24-9796-2477465c9437', 'bc15688a-089f-4071-9a2b-93e87f28f846', 'd81f2be6-2daa-4694-bfd3-496e64f467ac', 'f35bb388-1251-4b12-b65e-3b2d1b58dda5', '81b4d229-34c1-420c-acac-a5e9d44d33e5', '225fb705-337d-4abe-9a25-de3a33d5a961', '7e086b64-be51-49af-ac2c-6312cfa54bf4', '7fdaff9b-63be-497c-8622-3160e739856a', '6706e233-99bc-4f71-accd-d13e8c487aed', '702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf', '0ae58702-5520-4afd-abbd-064c34515d9b', '21459423-ae1a-4ef3-b1fd-549e38f9136d', '60c7134e-2e86-428f-b754-45baab82ae62', '7eba410e-a0d6-4873-9363-054f457d21d4', '7aae69a5-1701-43e9-9978-86df7a832270', 'fab6b45f-3ae6-4550-ba52-182144930713', 'b1a5abeb-ac32-4d23-a23f-c0ae308abad8', '11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f', '21b36777-ea5b-4b29-980a-dc95fc42eb85', '40f3bd9f-8637-49e8-92cd-03812c846cfd', 'f396ecc9-2832-4971-bf67-f8c7289f9916', 'a9141c37-2b91-4c20-add2-e8a0090bfc23', 'fb749722-17ca-41f8-9be5-6aa59fad95b3', 'a7b62144-a34e-4e44-9dda-a1306bb3fa05', '48d70a54-3f5c-40ef-9cc4-f5d82c01a717', '8f8bd1f0-245d-4d6b-8841-4e7773984ffb', 'e31e2ae5-2f08-403b-b19a-697a36f3cb16', '26f7f40b-869b-4715-bb99-c61da31c1672', 'd76d1ef7-21d9-442e-8d89-3b9cfee5a4ac', 'ff50f1ab-6b6a-400e-a79f-0d29ae875687', '6440e2db-5336-4fd7-b450-468fa8f78560', 'c3844e5d-1857-4823-ae42-ffaed25f95f9', '361f5d4b-d775-40f2-9486-50f4511d4852', 'dd313130-fb41-4c30-96a8-0facc1385d33', 'b3cdaff7-e960-4617-83ae-85aa804dab73', '154896d4-d0bc-49e9-8d89-5fcc04260b1a', '287306e2-c53f-4a5f-82ab-b97a6d8f9e37', 'd2ff1e5d-d0c8-419d-bc14-18543641dd30', '5a8bd4df-a8df-4d64-94ea-a00a62c48a01', '1712776d-764c-405e-85d0-105070b4c2e8', '25d6107d-095d-4250-920f-5b89f0d9b75b', 'a6054485-180a-4f29-a65a-3151187db51e', '394b8a58-53d4-4ddb-998c-b2810a22cd53', '215a1eaa-c047-4dab-aaf3-49d2cea752dc', '0a9f1a73-f43f-451c-8ce2-328d0b73b769', '156af133-c5cb-4af5-87be-b21d4422308a'} {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1329.708061] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1329.727769] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.728045] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.728154] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.728489] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.728647] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.728835] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1329.728969] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1329.729146] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1329.812081] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.812316] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.812316] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.812545] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.813667] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.813930] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1329.814013] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1329.814087] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1329.814141] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1329.814290] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1329.814290] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aca15fc8-3d94-4e24-9796-2477465c9437 with Priority: HIGH for action security_group_rules [ 1329.814407] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bc15688a-089f-4071-9a2b-93e87f28f846 with Priority: HIGH for action security_group_rules [ 1329.814464] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGH for action security_group_rules [ 1329.814518] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGH for action security_group_rules [ 1329.814568] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGH for action security_group_rules [ 1329.814626] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 225fb705-337d-4abe-9a25-de3a33d5a961 with Priority: HIGH for action security_group_rules [ 1329.814687] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 with Priority: HIGH for action security_group_rules [ 1329.814769] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGH for action security_group_rules [ 1329.814769] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6706e233-99bc-4f71-accd-d13e8c487aed with Priority: HIGH for action security_group_rules [ 1329.814874] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf with Priority: HIGH for action security_group_rules [ 1329.814874] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGH for action security_group_rules [ 1329.814980] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGH for action security_group_rules [ 1329.814980] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGH for action security_group_rules [ 1329.815103] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGH for action security_group_rules [ 1329.815103] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGH for action security_group_rules [ 1329.815210] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fab6b45f-3ae6-4550-ba52-182144930713 with Priority: HIGH for action security_group_rules [ 1329.815210] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b1a5abeb-ac32-4d23-a23f-c0ae308abad8 with Priority: HIGH for action security_group_rules [ 1329.815314] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f with Priority: HIGH for action security_group_rules [ 1329.815314] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 with Priority: HIGH for action security_group_rules [ 1329.815418] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd with Priority: HIGH for action security_group_rules [ 1329.815467] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.479795] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1330.480237] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1330.480237] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aca15fc8-3d94-4e24-9796-2477465c9437 with Priority: HIGH for action security_group_rules [ 1330.480237] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d81f2be6-2daa-4694-bfd3-496e64f467ac with Priority: HIGH for action security_group_rules [ 1330.480371] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 with Priority: HIGH for action security_group_rules [ 1330.480412] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aae69a5-1701-43e9-9978-86df7a832270 with Priority: HIGH for action security_group_rules [ 1330.480503] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd with Priority: HIGH for action security_group_rules [ 1330.480595] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 with Priority: HIGH for action security_group_rules [ 1330.480686] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f with Priority: HIGH for action security_group_rules [ 1330.480776] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a5abeb-ac32-4d23-a23f-c0ae308abad8 with Priority: HIGH for action security_group_rules [ 1330.480860] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7eba410e-a0d6-4873-9363-054f457d21d4 with Priority: HIGH for action security_group_rules [ 1330.480947] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab6b45f-3ae6-4550-ba52-182144930713 with Priority: HIGH for action security_group_rules [ 1330.481045] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c7134e-2e86-428f-b754-45baab82ae62 with Priority: HIGH for action security_group_rules [ 1330.481135] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGH for action security_group_rules [ 1330.481221] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGH for action security_group_rules [ 1330.481307] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf with Priority: HIGH for action security_group_rules [ 1330.481392] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6706e233-99bc-4f71-accd-d13e8c487aed with Priority: HIGH for action security_group_rules [ 1330.481476] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 225fb705-337d-4abe-9a25-de3a33d5a961 with Priority: HIGH for action security_group_rules [ 1330.481560] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fdaff9b-63be-497c-8622-3160e739856a with Priority: HIGH for action security_group_rules [ 1330.481643] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 with Priority: HIGH for action security_group_rules [ 1330.481725] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc15688a-089f-4071-9a2b-93e87f28f846 with Priority: HIGH for action security_group_rules [ 1330.481810] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGH for action security_group_rules [ 1330.482180] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aca15fc8-3d94-4e24-9796-2477465c9437 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.482313] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.482378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.482598] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.482685] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aca15fc8-3d94-4e24-9796-2477465c9437',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.483708] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d81f2be6-2daa-4694-bfd3-496e64f467ac taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.483829] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.483898] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.484081] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.484157] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d81f2be6-2daa-4694-bfd3-496e64f467ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.485390] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e086b64-be51-49af-ac2c-6312cfa54bf4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.485507] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.485574] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.485728] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.485800] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e086b64-be51-49af-ac2c-6312cfa54bf4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.486488] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7aae69a5-1701-43e9-9978-86df7a832270 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.486609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.486656] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.486797] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.486869] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7aae69a5-1701-43e9-9978-86df7a832270',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.487570] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40f3bd9f-8637-49e8-92cd-03812c846cfd taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.487676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.487905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.487905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.487905] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40f3bd9f-8637-49e8-92cd-03812c846cfd',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.488594] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21b36777-ea5b-4b29-980a-dc95fc42eb85 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.488701] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.488767] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.488918] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.488984] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21b36777-ea5b-4b29-980a-dc95fc42eb85',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.489774] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.489878] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.489943] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.490105] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.490211] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.490851] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1a5abeb-ac32-4d23-a23f-c0ae308abad8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.490958] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.491035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.491189] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.491272] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1a5abeb-ac32-4d23-a23f-c0ae308abad8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.491936] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7eba410e-a0d6-4873-9363-054f457d21d4 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.492055] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.492120] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.492271] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.492346] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7eba410e-a0d6-4873-9363-054f457d21d4',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.492990] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fab6b45f-3ae6-4550-ba52-182144930713 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.493152] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.493197] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.493311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.493381] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fab6b45f-3ae6-4550-ba52-182144930713',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.494143] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60c7134e-2e86-428f-b754-45baab82ae62 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.494250] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.494318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.494458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.494531] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60c7134e-2e86-428f-b754-45baab82ae62',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.495193] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21459423-ae1a-4ef3-b1fd-549e38f9136d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.495298] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.495366] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.495513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.495589] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.496376] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.496376] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.496567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.496567] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.496646] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.497371] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.497523] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.497580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.497699] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.497752] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.498427] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6706e233-99bc-4f71-accd-d13e8c487aed taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.498517] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.498589] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.498736] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.498805] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6706e233-99bc-4f71-accd-d13e8c487aed',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.499462] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-225fb705-337d-4abe-9a25-de3a33d5a961 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.499578] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.499638] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.499768] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.499839] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('225fb705-337d-4abe-9a25-de3a33d5a961',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.500543] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fdaff9b-63be-497c-8622-3160e739856a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.500754] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.500754] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.500859] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.500900] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fdaff9b-63be-497c-8622-3160e739856a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.501659] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81b4d229-34c1-420c-acac-a5e9d44d33e5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.501763] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.501830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.501977] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.502080] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81b4d229-34c1-420c-acac-a5e9d44d33e5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.502713] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc15688a-089f-4071-9a2b-93e87f28f846 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.502806] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.502872] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.503027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.503102] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc15688a-089f-4071-9a2b-93e87f28f846',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.503751] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.503864] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.503932] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.504122] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.504175] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.009355] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.009590] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.009590] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.009842] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.010050] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.010234] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.010307] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.010499] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.010607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.010718] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.010824] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.013066] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-21459423-ae1a-4ef3-b1fd-549e38f9136d taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.013184] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.013229] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.013479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.013661] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.013782] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.013852] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.014015] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.014099] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.014185] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.014269] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.030469] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f35bb388-1251-4b12-b65e-3b2d1b58dda5 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.030751] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.030751] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.030850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.030983] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.031401] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.031401] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.031401] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.031401] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.031599] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.031599] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.044306] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.070616] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.070873] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.070873] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.071074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.072543] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.072761] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.073504] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.073623] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.079270] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.079492] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.079741] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.079857] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.083455] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.083587] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.084282] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.084509] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.086516] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.086619] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.087332] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.087436] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.088153] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.088253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.088949] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.089054] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.089633] env[69920]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1331.090074] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.090201] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.090755] env[69920]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1331.091138] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.091246] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.091901] env[69920]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1331.092264] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.092358] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.092991] env[69920]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1331.093349] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.093459] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.094096] env[69920]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1331.094453] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.094541] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.095161] env[69920]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1331.095572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.095683] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc15688a-089f-4071-9a2b-93e87f28f846 is going to be deleted. [ 1331.096576] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.096792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.098175] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.098260] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.115685] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.115852] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7eba410e-a0d6-4873-9363-054f457d21d4 is going to be deleted. [ 1331.116753] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.116970] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.133164] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.133336] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aca15fc8-3d94-4e24-9796-2477465c9437 is going to be deleted. [ 1331.134105] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.134316] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.154250] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.154434] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e086b64-be51-49af-ac2c-6312cfa54bf4 is going to be deleted. [ 1331.155309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.155598] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.170512] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.170758] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.176263] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.176393] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.177176] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.177292] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d81f2be6-2daa-4694-bfd3-496e64f467ac is going to be deleted. [ 1331.178153] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.178365] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.211146] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.211319] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fdaff9b-63be-497c-8622-3160e739856a is going to be deleted. [ 1331.212264] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.212511] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.228159] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.228378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.255507] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.255735] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.260940] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.261104] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81b4d229-34c1-420c-acac-a5e9d44d33e5 is going to be deleted. [ 1331.262245] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.262459] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.264856] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.264977] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.298159] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.298353] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6706e233-99bc-4f71-accd-d13e8c487aed is going to be deleted. [ 1331.299273] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.299505] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.354378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.354724] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fab6b45f-3ae6-4550-ba52-182144930713 is going to be deleted. [ 1331.357602] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.357602] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.379228] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.379503] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.411828] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.412106] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7aae69a5-1701-43e9-9978-86df7a832270 is going to be deleted. [ 1331.413020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.413315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.456379] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.456564] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1a5abeb-ac32-4d23-a23f-c0ae308abad8 is going to be deleted. [ 1331.457562] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.457811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.477135] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.477373] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.477996] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.478122] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.503751] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.504119] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60c7134e-2e86-428f-b754-45baab82ae62 is going to be deleted. [ 1331.504843] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.505082] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.523883] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.524895] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.548199] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.548412] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.558086] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f35bb388-1251-4b12-b65e-3b2d1b58dda5: rpc.has_security_group_logging(os_id): False [ 1331.560500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.560659] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 225fb705-337d-4abe-9a25-de3a33d5a961 is going to be deleted. [ 1331.561508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.561727] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.634496] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.634732] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.663205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.663396] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40f3bd9f-8637-49e8-92cd-03812c846cfd is going to be deleted. [ 1331.664674] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.665377] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.675879] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.676118] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.676895] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.676998] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.709717] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.709975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.770064] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.770299] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.788706] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.788902] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21b36777-ea5b-4b29-980a-dc95fc42eb85 is going to be deleted. [ 1331.789814] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.789956] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.835862] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.836018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.840236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.840376] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f is going to be deleted. [ 1331.841382] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.841613] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.893130] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.893326] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf is going to be deleted. [ 1331.894205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.894436] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.894527] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.894657] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc15688a-089f-4071-9a2b-93e87f28f846" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.894816] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.894970] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.895064] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.895186] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7eba410e-a0d6-4873-9363-054f457d21d4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.895718] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.895879] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.895960] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.896096] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aca15fc8-3d94-4e24-9796-2477465c9437" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.896223] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.896368] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.896447] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.896543] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d81f2be6-2daa-4694-bfd3-496e64f467ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.896661] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.896800] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.896875] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.896988] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e086b64-be51-49af-ac2c-6312cfa54bf4" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.897125] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.897267] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.897344] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.897452] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fdaff9b-63be-497c-8622-3160e739856a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.897574] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.897713] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.897790] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.897902] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6706e233-99bc-4f71-accd-d13e8c487aed" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.898034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.898205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.898280] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.898398] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81b4d229-34c1-420c-acac-a5e9d44d33e5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.898522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.898662] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.898737] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.898849] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fab6b45f-3ae6-4550-ba52-182144930713" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.898973] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.899131] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.925338] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.925653] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.925755] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.925824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.926030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.926116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.926209] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 is going to be updated. [ 1331.927272] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.927449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.927536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.927653] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7aae69a5-1701-43e9-9978-86df7a832270" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.927785] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.927926] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.928010] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.928154] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1a5abeb-ac32-4d23-a23f-c0ae308abad8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.928313] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.928461] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.928539] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.928653] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60c7134e-2e86-428f-b754-45baab82ae62" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.928772] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.928911] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.928987] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.929107] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-225fb705-337d-4abe-9a25-de3a33d5a961" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.929750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.929836] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.929908] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.930032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40f3bd9f-8637-49e8-92cd-03812c846cfd" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.967795] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.968027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.968027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.968274] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.968371] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.968498] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21b36777-ea5b-4b29-980a-dc95fc42eb85" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.978620] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.978839] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.978839] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.979056] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.979153] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.979286] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-702dfd87-dd48-4d7b-b5a3-468e5ebfd1cf" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.996882] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.997117] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.997117] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.997305] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.997395] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.997517] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11129e7c-e5ae-49a3-b04d-f46f9a7e2b5f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.027132] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21459423-ae1a-4ef3-b1fd-549e38f9136d: rpc.has_security_group_logging(os_id): False [ 1332.028331] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ae58702-5520-4afd-abbd-064c34515d9b: rpc.has_security_group_logging(os_id): False [ 1332.059326] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.059536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.059536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.059697] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.061115] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.061258] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.107104] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.107335] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.126527] env[69920]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1332.127141] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.127452] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.127573] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.127644] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.127844] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.127924] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.128030] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d is going to be updated. [ 1332.129103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.129284] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.180944] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.181353] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.181470] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.181536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.181743] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.181826] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.181914] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b is going to be updated. [ 1332.183029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.183209] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.183350] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.220033] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: IN_PROGRESS for 2s [ 1332.285827] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.286060] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.286060] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.286264] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.286408] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.288277] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.288406] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.288449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.288630] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.288761] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.329070] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d in Status: IN_PROGRESS for 2s [ 1332.329969] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: IN_PROGRESS for 2s [ 1334.233900] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: SUCCESS [ 1334.234292] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.344635] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d in Status: SUCCESS [ 1334.344841] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.345607] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: SUCCESS [ 1334.345857] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.483201] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.483615] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1340.484742] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1340.485019] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1345.298903] env[69920]: INFO networking_nsxv3.common.synchronization [req-45bfd641-365f-4eac-900b-cf266984ba00 req-24fa4650-6e74-4177-b785-0583e451a338 tempest-ServerActionsTestOtherA-296658517 tempest-ServerActionsTestOtherA-296658517-project-member] Enqueued Resource ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d with Priority: HIGHEST for action security_group_members [ 1345.299766] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d with Priority: HIGHEST for action security_group_members [ 1345.299766] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.299960] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.299960] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.300228] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.300408] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.300523] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.300593] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.300723] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.300900] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.300900] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe28dbbd-b7cc-4e07-960a-5aebbacb607d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.563459] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-26 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.563657] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.563784] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.564069] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.564434] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.565145] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.565334] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.565591] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.565730] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.565952] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1345.566088] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1345.566210] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1345.566744] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1345.566744] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1345.566744] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1345.566744] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1345.585155] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1345.585350] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1345.585475] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1345.585655] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.585965] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-4d10cd3a-98db-44a5-a193-057f208e8f72 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.586155] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-4d10cd3a-98db-44a5-a193-057f208e8f72" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.586278] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-4d10cd3a-98db-44a5-a193-057f208e8f72" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.586597] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-4d10cd3a-98db-44a5-a193-057f208e8f72" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.586740] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d10cd3a-98db-44a5-a193-057f208e8f72',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.804051] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.804051] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.804051] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.804051] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.804389] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.804389] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.804389] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.804519] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.804692] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.804692] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.804811] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d already deleted. [ 1345.804811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.089231] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.089497] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.089578] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.089876] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.090086] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.090260] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 4d10cd3a-98db-44a5-a193-057f208e8f72 not found, creating... [ 1346.090559] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.090736] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.090841] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.091091] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.091241] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.091582] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.091882] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.091882] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.092100] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.092241] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.092389] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 4d10cd3a-98db-44a5-a193-057f208e8f72 is going to be created. [ 1346.112611] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.112811] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.112940] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.113237] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.113477] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.113716] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-4d10cd3a-98db-44a5-a193-057f208e8f72" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.813493] env[69920]: INFO networking_nsxv3.common.synchronization [req-45bfd641-365f-4eac-900b-cf266984ba00 req-a4bd4bc4-6118-4260-869d-a3f32fa20b45 service nova] Enqueued Resource ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d with Priority: HIGHEST for action security_group_rules [ 1346.813798] env[69920]: INFO networking_nsxv3.common.synchronization [req-45bfd641-365f-4eac-900b-cf266984ba00 req-a4bd4bc4-6118-4260-869d-a3f32fa20b45 service nova] Enqueued Resource ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d with Priority: HIGHEST for action security_group_members [ 1346.813945] env[69920]: INFO networking_nsxv3.common.synchronization [req-45bfd641-365f-4eac-900b-cf266984ba00 req-a4bd4bc4-6118-4260-869d-a3f32fa20b45 service nova] Enqueued Resource ID: 4d10cd3a-98db-44a5-a193-057f208e8f72 with Priority: HIGHEST for action port [ 1346.814128] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d with Priority: HIGHEST for action security_group_rules [ 1346.814260] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d with Priority: HIGHEST for action security_group_members [ 1346.814368] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d10cd3a-98db-44a5-a193-057f208e8f72 with Priority: HIGHEST for action port [ 1346.814910] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe28dbbd-b7cc-4e07-960a-5aebbacb607d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.815045] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.815188] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.815362] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.815443] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe28dbbd-b7cc-4e07-960a-5aebbacb607d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.816444] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.816519] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.816561] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.817655] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.817655] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.817655] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.817655] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.817655] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.817655] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.817655] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe28dbbd-b7cc-4e07-960a-5aebbacb607d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.818317] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d10cd3a-98db-44a5-a193-057f208e8f72 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.818317] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d10cd3a-98db-44a5-a193-057f208e8f72" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.818317] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d10cd3a-98db-44a5-a193-057f208e8f72" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.818317] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d10cd3a-98db-44a5-a193-057f208e8f72" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.818799] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d10cd3a-98db-44a5-a193-057f208e8f72',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.321066] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.321066] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.321066] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe28dbbd-b7cc-4e07-960a-5aebbacb607d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1347.321919] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d10cd3a-98db-44a5-a193-057f208e8f72 with status ACTIVE [ 1347.322108] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.322223] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.322287] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.322495] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.322609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.322803] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.322903] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.322963] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.323142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.323220] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.323399] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.323492] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.323578] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.323687] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.323760] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.323843] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d10cd3a-98db-44a5-a193-057f208e8f72 is going to be updated. [ 1347.346678] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.346905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.346905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.347101] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.347236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.347401] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d10cd3a-98db-44a5-a193-057f208e8f72" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.826236] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe28dbbd-b7cc-4e07-960a-5aebbacb607d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.329108] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.329356] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.329412] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.329650] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.329737] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.329843] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d is going to be created. [ 1348.355219] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.355420] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.355468] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.355964] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.355964] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.366103] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d in Status: UNINITIALIZED for 2s [ 1350.378465] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d in Status: SUCCESS [ 1350.378853] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.378949] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.379259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.379503] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.379622] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.379755] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.379951] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.380062] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.380218] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.380280] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe28dbbd-b7cc-4e07-960a-5aebbacb607d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.883182] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.883429] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.883429] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.883620] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.883783] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.883873] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.883929] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.884100] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.884193] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.884272] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.884419] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.884511] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.884568] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.884705] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.884840] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.884949] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.885025] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.885167] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.885242] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.885323] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.885412] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe28dbbd-b7cc-4e07-960a-5aebbacb607d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.387806] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe28dbbd-b7cc-4e07-960a-5aebbacb607d: rpc.has_security_group_logging(os_id): False [ 1351.405856] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.406124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.406124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.406297] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.406389] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.406596] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.406697] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.406760] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.406916] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.407030] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.407202] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.407295] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.407355] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.407504] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.407595] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.407791] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.407906] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.407966] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.408115] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.408189] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.408275] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d is going to be created. [ 1351.466113] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.466329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.466390] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.466564] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.466749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.478346] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d in Status: IN_PROGRESS for 2s [ 1351.814923] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1351.815196] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1353.492041] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d in Status: SUCCESS [ 1353.492437] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.816370] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1356.816800] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1361.817430] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1361.817838] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1366.506282] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.506650] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-690" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.506828] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-690" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.507241] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-690" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.507675] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.507936] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.508245] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.508506] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.508781] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.509130] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1366.509327] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1366.509527] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1366.509724] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1366.509932] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1366.510150] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1366.510386] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1366.532380] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1366.532673] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1366.532929] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1366.533237] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-690" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.533733] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-cdd401dc-1a64-40f2-931e-f19611bb56d3 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.534201] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-cdd401dc-1a64-40f2-931e-f19611bb56d3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.534464] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-cdd401dc-1a64-40f2-931e-f19611bb56d3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.534883] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-cdd401dc-1a64-40f2-931e-f19611bb56d3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.535149] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdd401dc-1a64-40f2-931e-f19611bb56d3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.818250] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1366.818467] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1367.038267] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.038584] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.038584] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.038898] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.039092] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.039379] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.039549] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.039672] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.039956] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.040163] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.040493] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.040689] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.040824] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.041173] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.041338] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.041595] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: cdd401dc-1a64-40f2-931e-f19611bb56d3 is going to be updated. [ 1367.064703] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.065030] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.065167] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.065536] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.065788] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.066282] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-cdd401dc-1a64-40f2-931e-f19611bb56d3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.759589] env[69920]: INFO networking_nsxv3.common.synchronization [req-40d44a1f-0b6b-44e7-9c32-982c11aafccc req-782220e7-cb4a-47bc-a318-31ffebbfa223 service nova] Enqueued Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_rules [ 1367.759589] env[69920]: INFO networking_nsxv3.common.synchronization [req-40d44a1f-0b6b-44e7-9c32-982c11aafccc req-782220e7-cb4a-47bc-a318-31ffebbfa223 service nova] Enqueued Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_members [ 1367.759589] env[69920]: INFO networking_nsxv3.common.synchronization [req-40d44a1f-0b6b-44e7-9c32-982c11aafccc req-782220e7-cb4a-47bc-a318-31ffebbfa223 service nova] Enqueued Resource ID: cdd401dc-1a64-40f2-931e-f19611bb56d3 with Priority: HIGHEST for action port [ 1367.759589] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_rules [ 1367.759589] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_members [ 1367.759589] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdd401dc-1a64-40f2-931e-f19611bb56d3 with Priority: HIGHEST for action port [ 1367.760455] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.760455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.760455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.760455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.760455] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.762027] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.762027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.762027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.762248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.762410] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.762584] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.762628] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.762797] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.762887] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.762983] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.764993] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdd401dc-1a64-40f2-931e-f19611bb56d3 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.765220] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdd401dc-1a64-40f2-931e-f19611bb56d3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.765298] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdd401dc-1a64-40f2-931e-f19611bb56d3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.765461] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdd401dc-1a64-40f2-931e-f19611bb56d3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.765540] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdd401dc-1a64-40f2-931e-f19611bb56d3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.263244] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.263464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.265806] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.266788] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cdd401dc-1a64-40f2-931e-f19611bb56d3 with status ACTIVE [ 1368.267049] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.267195] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.267257] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.267476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.267599] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.267825] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.267956] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.268034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.268208] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.268309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.268536] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.268638] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.268693] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.268833] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.268927] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.269041] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cdd401dc-1a64-40f2-931e-f19611bb56d3 is going to be updated. [ 1368.292125] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.292369] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.292369] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.292555] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.292674] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.292833] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdd401dc-1a64-40f2-931e-f19611bb56d3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.771493] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.274269] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.274269] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.274572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.274572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.274641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.274808] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b is going to be updated. [ 1369.306408] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.306729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.306729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.306844] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.306963] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.316362] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: IN_PROGRESS for 2s [ 1371.327546] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: SUCCESS [ 1371.327840] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.327887] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.328139] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.328331] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.328449] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.328531] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.328722] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.328809] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.328898] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.328986] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.831648] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.965757] env[69920]: INFO networking_nsxv3.common.synchronization [req-9eadf668-ec58-43be-81ed-96c11c1e9925 req-b29599ff-1fca-472d-88c8-047df0666b8a tempest-ServerActionsTestOtherA-296658517 tempest-ServerActionsTestOtherA-296658517-project-member] Enqueued Resource ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d with Priority: HIGHEST for action security_group_members [ 1371.966447] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d with Priority: HIGHEST for action security_group_members [ 1371.966842] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.967010] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.967253] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.967560] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.967711] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.967850] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.967938] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.968173] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.968289] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.969066] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe28dbbd-b7cc-4e07-960a-5aebbacb607d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.333871] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ae58702-5520-4afd-abbd-064c34515d9b: rpc.has_security_group_logging(os_id): False [ 1372.351600] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.351811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.351889] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.352069] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.352166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.352415] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.352513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.352647] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.352751] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.352825] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.352904] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b is going to be updated. [ 1372.416740] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.416977] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.416977] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.417204] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.417319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.432352] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: IN_PROGRESS for 2s [ 1372.471108] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.471358] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.471358] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.471533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.471636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.471890] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.472081] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.472151] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.472329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.472427] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.472520] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d is going to be updated. [ 1372.498737] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.498975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.499081] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.499326] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.499491] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.511367] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d in Status: IN_PROGRESS for 2s [ 1374.449802] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: SUCCESS [ 1374.450267] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.521848] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d in Status: SUCCESS [ 1374.522128] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d deletion is rescheduled due to dependency. [ 1374.522196] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.160020] env[69920]: INFO networking_nsxv3.common.synchronization [None req-dc97e003-0b7a-4b4b-9e73-b2ec9d852064 tempest-ServerActionsTestOtherA-296658517 tempest-ServerActionsTestOtherA-296658517-project-member] Enqueued Resource ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a with Priority: HIGHEST for action security_group_rules [ 1376.160020] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a with Priority: HIGHEST for action security_group_rules [ 1376.160851] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff58ec7f-6e34-4927-96bc-f7b93587dd0a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.160851] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.160851] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.161028] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.161028] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff58ec7f-6e34-4927-96bc-f7b93587dd0a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.274345] env[69920]: INFO networking_nsxv3.common.synchronization [None req-0a85e267-cc7f-4e5c-9939-d498666eae3c tempest-ServerActionsTestOtherA-296658517 tempest-ServerActionsTestOtherA-296658517-project-member] Enqueued Resource ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a with Priority: HIGHEST for action security_group_rules [ 1376.275086] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a with Priority: HIGHEST for action security_group_rules [ 1376.275086] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff58ec7f-6e34-4927-96bc-f7b93587dd0a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.275216] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.684793] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.684963] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.685047] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.685275] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.685369] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.685469] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a already deleted. [ 1376.685551] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.685703] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.685862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.685948] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff58ec7f-6e34-4927-96bc-f7b93587dd0a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.207750] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.207750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.207750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.207750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.207750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.207750] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a already deleted. [ 1377.207750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.276162] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1381.276633] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1381.568405] env[69920]: INFO networking_nsxv3.common.synchronization [req-2481f842-67cb-4762-8d39-1760d9b47740 req-a5fb8098-b99d-497b-95e3-630898308b49 tempest-ServerActionsTestOtherA-296658517 tempest-ServerActionsTestOtherA-296658517-project-member] Enqueued Resource ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a with Priority: HIGHEST for action security_group_members [ 1381.568904] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a with Priority: HIGHEST for action security_group_members [ 1381.569210] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff58ec7f-6e34-4927-96bc-f7b93587dd0a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.569345] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.569450] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.569706] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.569856] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.569977] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.570027] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.570195] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.570290] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.570380] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff58ec7f-6e34-4927-96bc-f7b93587dd0a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.840772] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-26 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.840997] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.841150] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.841419] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.841681] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.841843] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.841985] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.842212] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.842359] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.842574] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1381.842731] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1381.842805] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1381.842905] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1381.843029] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1381.843217] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1381.843403] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1381.863040] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1381.863206] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1381.863355] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1381.863539] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.863858] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-6b4007d2-3eea-417e-b36d-28ced978b73f taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.864044] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-6b4007d2-3eea-417e-b36d-28ced978b73f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.864175] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-6b4007d2-3eea-417e-b36d-28ced978b73f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.864485] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-6b4007d2-3eea-417e-b36d-28ced978b73f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.864631] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b4007d2-3eea-417e-b36d-28ced978b73f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.073109] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.073339] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.073396] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.073580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.073670] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.073859] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.073956] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.074038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.074199] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.074275] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.074361] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a already deleted. [ 1382.074445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.368496] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.368940] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.368940] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.369159] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.369437] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.369754] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 6b4007d2-3eea-417e-b36d-28ced978b73f not found, creating... [ 1382.369754] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.369948] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.370111] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.370397] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.370545] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.370861] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.371049] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.371177] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.371396] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.371537] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.371683] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 6b4007d2-3eea-417e-b36d-28ced978b73f is going to be created. [ 1382.397319] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.397579] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.397655] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.397936] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.398199] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.398512] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-6b4007d2-3eea-417e-b36d-28ced978b73f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.081131] env[69920]: INFO networking_nsxv3.common.synchronization [req-2481f842-67cb-4762-8d39-1760d9b47740 req-7f6f69f8-6803-4e95-844b-976fa0058c50 service nova] Enqueued Resource ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a with Priority: HIGHEST for action security_group_rules [ 1383.081213] env[69920]: INFO networking_nsxv3.common.synchronization [req-2481f842-67cb-4762-8d39-1760d9b47740 req-7f6f69f8-6803-4e95-844b-976fa0058c50 service nova] Enqueued Resource ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a with Priority: HIGHEST for action security_group_members [ 1383.081361] env[69920]: INFO networking_nsxv3.common.synchronization [req-2481f842-67cb-4762-8d39-1760d9b47740 req-7f6f69f8-6803-4e95-844b-976fa0058c50 service nova] Enqueued Resource ID: 6b4007d2-3eea-417e-b36d-28ced978b73f with Priority: HIGHEST for action port [ 1383.081874] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a with Priority: HIGHEST for action security_group_rules [ 1383.082019] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a with Priority: HIGHEST for action security_group_members [ 1383.082168] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b4007d2-3eea-417e-b36d-28ced978b73f with Priority: HIGHEST for action port [ 1383.082391] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff58ec7f-6e34-4927-96bc-f7b93587dd0a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.082593] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.082593] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.082811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.082899] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff58ec7f-6e34-4927-96bc-f7b93587dd0a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.085656] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff58ec7f-6e34-4927-96bc-f7b93587dd0a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.085840] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.085968] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.086287] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.086793] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.086793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.086793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.087013] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.087013] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.087094] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff58ec7f-6e34-4927-96bc-f7b93587dd0a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.088413] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b4007d2-3eea-417e-b36d-28ced978b73f taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.088413] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b4007d2-3eea-417e-b36d-28ced978b73f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.088413] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b4007d2-3eea-417e-b36d-28ced978b73f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.088413] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b4007d2-3eea-417e-b36d-28ced978b73f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.088413] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b4007d2-3eea-417e-b36d-28ced978b73f',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.589807] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff58ec7f-6e34-4927-96bc-f7b93587dd0a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.591068] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff58ec7f-6e34-4927-96bc-f7b93587dd0a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.591186] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.591898] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b4007d2-3eea-417e-b36d-28ced978b73f with status ACTIVE [ 1383.591898] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.591898] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.591898] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.591898] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.592264] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.592264] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.592264] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.592398] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.592482] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.592548] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.592721] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.592836] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.592905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.593060] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.593137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.593268] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b4007d2-3eea-417e-b36d-28ced978b73f is going to be updated. [ 1383.615640] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.615918] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.615918] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.616071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.616232] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.616398] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b4007d2-3eea-417e-b36d-28ced978b73f" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.095492] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff58ec7f-6e34-4927-96bc-f7b93587dd0a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.337173] env[69920]: INFO networking_nsxv3.common.synchronization [req-5bcf54a3-fc57-4799-97ae-a3b4408c8388 req-92a3fca0-0c1e-4733-b193-74c05cec6c69 tempest-ServerActionsTestOtherB-54229569 tempest-ServerActionsTestOtherB-54229569-project-member] Enqueued Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_members [ 1384.337173] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGHEST for action security_group_members [ 1384.337333] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.337417] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.337464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.337663] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.337839] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.337938] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.338018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.338175] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.338289] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.338364] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.600225] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.600225] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.600225] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.600225] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.600225] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.600225] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a is going to be created. [ 1384.623911] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.623911] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.623911] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.623911] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.623911] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.632646] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a in Status: UNINITIALIZED for 2s [ 1384.841053] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.841235] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.841311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.841530] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.841624] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.841828] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.841927] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.842041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.842147] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.842224] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.842346] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b is going to be updated. [ 1384.870887] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.871213] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.871213] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.871372] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.871514] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.880472] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: IN_PROGRESS for 2s [ 1386.641830] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a in Status: SUCCESS [ 1386.642080] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.642219] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.642481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.642675] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.642837] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.642878] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.643049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.643173] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.643242] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.643300] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ff58ec7f-6e34-4927-96bc-f7b93587dd0a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.889725] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ae58702-5520-4afd-abbd-064c34515d9b in Status: SUCCESS [ 1386.889972] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b deletion is rescheduled due to dependency. [ 1386.890065] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.145698] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ff58ec7f-6e34-4927-96bc-f7b93587dd0a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.647951] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ff58ec7f-6e34-4927-96bc-f7b93587dd0a: rpc.has_security_group_logging(os_id): False [ 1387.666446] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.666683] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.666683] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.666856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.666948] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.667195] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.667317] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.667374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.667505] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.667581] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.667668] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a is going to be created. [ 1387.754401] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.754634] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.754754] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.755119] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.755417] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.767453] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a in Status: IN_PROGRESS for 2s [ 1389.338282] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1389.338657] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1389.779536] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a in Status: SUCCESS [ 1389.779536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.339195] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1394.339533] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1395.353198] env[69920]: INFO networking_nsxv3.common.synchronization [None req-2f6e477b-a899-4bf7-99fd-a334bb21862a None None] Enqueued Resource ID: d980efe3-ed51-4dac-ac3f-42ee3e0bd339 with Priority: HIGHEST for action port [ 1395.353198] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d980efe3-ed51-4dac-ac3f-42ee3e0bd339 with Priority: HIGHEST for action port [ 1395.353198] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-d980efe3-ed51-4dac-ac3f-42ee3e0bd339 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.353678] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d980efe3-ed51-4dac-ac3f-42ee3e0bd339" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.353858] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d980efe3-ed51-4dac-ac3f-42ee3e0bd339" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.354220] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d980efe3-ed51-4dac-ac3f-42ee3e0bd339" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.354398] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d980efe3-ed51-4dac-ac3f-42ee3e0bd339',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.857445] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d980efe3-ed51-4dac-ac3f-42ee3e0bd339 [ 1395.857725] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.857880] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.857954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.858194] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.858290] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.858386] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d980efe3-ed51-4dac-ac3f-42ee3e0bd339 already deleted. [ 1395.858468] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d980efe3-ed51-4dac-ac3f-42ee3e0bd339" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.669962] env[69920]: INFO networking_nsxv3.common.synchronization [None req-dbbd5009-95a8-42b9-83f5-9e9813c7011a None None] Enqueued Resource ID: 24f3c464-14c5-4e5a-85d7-91182ad33e04 with Priority: HIGHEST for action port [ 1397.670288] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24f3c464-14c5-4e5a-85d7-91182ad33e04 with Priority: HIGHEST for action port [ 1397.670800] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-24f3c464-14c5-4e5a-85d7-91182ad33e04 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.671142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24f3c464-14c5-4e5a-85d7-91182ad33e04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.671142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24f3c464-14c5-4e5a-85d7-91182ad33e04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.671313] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24f3c464-14c5-4e5a-85d7-91182ad33e04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.671392] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24f3c464-14c5-4e5a-85d7-91182ad33e04',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.174964] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 24f3c464-14c5-4e5a-85d7-91182ad33e04 [ 1398.175225] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.175340] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.175415] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.175591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.175683] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.175782] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:24f3c464-14c5-4e5a-85d7-91182ad33e04 already deleted. [ 1398.175871] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24f3c464-14c5-4e5a-85d7-91182ad33e04" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.739212] env[69920]: INFO networking_nsxv3.common.synchronization [req-738f0c8c-dd12-4023-8069-71dbc4a58fe4 req-0e15a9ce-f06a-46aa-950d-bb91490727ea tempest-ServerActionsTestJSON-2022006223 tempest-ServerActionsTestJSON-2022006223-project-member] Enqueued Resource ID: 25d6107d-095d-4250-920f-5b89f0d9b75b with Priority: HIGHEST for action security_group_members [ 1398.739212] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25d6107d-095d-4250-920f-5b89f0d9b75b with Priority: HIGHEST for action security_group_members [ 1398.739896] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-25d6107d-095d-4250-920f-5b89f0d9b75b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.740033] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.740077] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.740279] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.740436] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.740537] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.740602] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.740749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.740839] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.740973] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25d6107d-095d-4250-920f-5b89f0d9b75b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.243549] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.243729] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.243804] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.244032] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.268637] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.268901] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.269240] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.269240] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.269414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.269414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.269519] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25d6107d-095d-4250-920f-5b89f0d9b75b is going to be updated. [ 1399.296166] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.296469] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.296469] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.296611] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.296716] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.304808] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25d6107d-095d-4250-920f-5b89f0d9b75b in Status: IN_PROGRESS for 2s [ 1400.594200] env[69920]: INFO networking_nsxv3.common.synchronization [req-c789e608-78eb-44ee-ab09-69866b2ad29f req-d917fec9-11c9-4237-8187-728bffa96fff tempest-ServerPasswordTestJSON-1224543486 tempest-ServerPasswordTestJSON-1224543486-project-member] Enqueued Resource ID: 5d5014c2-302f-4390-94a8-c6bb31af6e0a with Priority: HIGHEST for action security_group_members [ 1400.595051] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d5014c2-302f-4390-94a8-c6bb31af6e0a with Priority: HIGHEST for action security_group_members [ 1400.595506] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d5014c2-302f-4390-94a8-c6bb31af6e0a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.595680] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.595775] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.596154] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.596572] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.596572] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.596756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.597050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.598040] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.598040] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d5014c2-302f-4390-94a8-c6bb31af6e0a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.880315] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.880508] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-381" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.880644] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-381" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.881033] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-381" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.881307] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.881533] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.881606] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.881811] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.882184] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.882432] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1400.882556] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1400.882671] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1400.882784] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1400.882900] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1400.883019] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1400.883165] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1400.902029] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1400.902235] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1400.902382] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1400.902562] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-381" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.902885] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-2f031d13-6ba5-4d47-a0af-c37c122a67df taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.903075] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-2f031d13-6ba5-4d47-a0af-c37c122a67df" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.903204] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-2f031d13-6ba5-4d47-a0af-c37c122a67df" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.903557] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-2f031d13-6ba5-4d47-a0af-c37c122a67df" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.903704] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f031d13-6ba5-4d47-a0af-c37c122a67df',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1401.100348] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.100515] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.100583] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.100805] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.100904] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.101176] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.101322] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.101322] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.101476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.101549] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.101632] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d5014c2-302f-4390-94a8-c6bb31af6e0a already deleted. [ 1401.101711] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.314952] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25d6107d-095d-4250-920f-5b89f0d9b75b in Status: SUCCESS [ 1401.315146] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25d6107d-095d-4250-920f-5b89f0d9b75b deletion is rescheduled due to dependency. [ 1401.315252] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25d6107d-095d-4250-920f-5b89f0d9b75b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.405588] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.405807] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.405940] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.406252] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.406408] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.406569] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 2f031d13-6ba5-4d47-a0af-c37c122a67df not found, creating... [ 1401.406826] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.406990] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.407770] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.407770] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.407770] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.407770] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.407981] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.408037] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.408326] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.408399] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.408544] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 2f031d13-6ba5-4d47-a0af-c37c122a67df is going to be created. [ 1401.428453] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1401.428663] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1401.428794] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1401.429083] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1401.429317] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1401.429549] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-2f031d13-6ba5-4d47-a0af-c37c122a67df" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.106682] env[69920]: INFO networking_nsxv3.common.synchronization [req-c789e608-78eb-44ee-ab09-69866b2ad29f req-b0b5d0e4-263d-457a-ab7e-fd75633d1319 service nova] Enqueued Resource ID: 5d5014c2-302f-4390-94a8-c6bb31af6e0a with Priority: HIGHEST for action security_group_rules [ 1402.106951] env[69920]: INFO networking_nsxv3.common.synchronization [req-c789e608-78eb-44ee-ab09-69866b2ad29f req-b0b5d0e4-263d-457a-ab7e-fd75633d1319 service nova] Enqueued Resource ID: 5d5014c2-302f-4390-94a8-c6bb31af6e0a with Priority: HIGHEST for action security_group_members [ 1402.107030] env[69920]: INFO networking_nsxv3.common.synchronization [req-c789e608-78eb-44ee-ab09-69866b2ad29f req-b0b5d0e4-263d-457a-ab7e-fd75633d1319 service nova] Enqueued Resource ID: 2f031d13-6ba5-4d47-a0af-c37c122a67df with Priority: HIGHEST for action port [ 1402.107556] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d5014c2-302f-4390-94a8-c6bb31af6e0a with Priority: HIGHEST for action security_group_rules [ 1402.107695] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d5014c2-302f-4390-94a8-c6bb31af6e0a with Priority: HIGHEST for action security_group_members [ 1402.107828] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f031d13-6ba5-4d47-a0af-c37c122a67df with Priority: HIGHEST for action port [ 1402.108247] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d5014c2-302f-4390-94a8-c6bb31af6e0a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.108387] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.108459] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.108719] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.108804] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d5014c2-302f-4390-94a8-c6bb31af6e0a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1402.110047] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d5014c2-302f-4390-94a8-c6bb31af6e0a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.110205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.110205] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.110425] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.110764] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.110764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.110863] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.111060] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.111159] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.111257] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d5014c2-302f-4390-94a8-c6bb31af6e0a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1402.116022] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f031d13-6ba5-4d47-a0af-c37c122a67df taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.116022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f031d13-6ba5-4d47-a0af-c37c122a67df" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.116022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f031d13-6ba5-4d47-a0af-c37c122a67df" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.116022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f031d13-6ba5-4d47-a0af-c37c122a67df" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.116022] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f031d13-6ba5-4d47-a0af-c37c122a67df',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1402.614508] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d5014c2-302f-4390-94a8-c6bb31af6e0a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1402.615513] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d5014c2-302f-4390-94a8-c6bb31af6e0a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.615713] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.618143] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f031d13-6ba5-4d47-a0af-c37c122a67df with status ACTIVE [ 1402.618353] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.618656] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.618656] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.618775] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.618842] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.619028] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.619127] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.619168] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.619345] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.619513] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.619710] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.619806] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.619867] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.620020] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.620096] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.620269] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f031d13-6ba5-4d47-a0af-c37c122a67df is going to be updated. [ 1402.642063] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.642305] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.642305] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.642536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.642693] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.642886] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f031d13-6ba5-4d47-a0af-c37c122a67df" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.117992] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d5014c2-302f-4390-94a8-c6bb31af6e0a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1403.620822] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.621137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.621275] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.621526] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.621625] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.621735] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d5014c2-302f-4390-94a8-c6bb31af6e0a is going to be created. [ 1403.649150] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.649307] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.649385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.649592] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.649783] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.659752] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d5014c2-302f-4390-94a8-c6bb31af6e0a in Status: UNINITIALIZED for 2s [ 1405.670903] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d5014c2-302f-4390-94a8-c6bb31af6e0a in Status: SUCCESS [ 1405.671445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.671445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.671445] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.671691] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.671794] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.671855] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.671969] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.672067] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.672157] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.672252] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d5014c2-302f-4390-94a8-c6bb31af6e0a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.174483] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d5014c2-302f-4390-94a8-c6bb31af6e0a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.174780] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.174780] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.174863] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.175074] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.175189] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.175258] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.175486] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.175585] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.175678] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.175830] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d5014c2-302f-4390-94a8-c6bb31af6e0a taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.175924] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.175977] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.176139] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.176274] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.176364] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.176418] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.176549] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.176625] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.176706] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.176795] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d5014c2-302f-4390-94a8-c6bb31af6e0a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.681938] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d5014c2-302f-4390-94a8-c6bb31af6e0a: rpc.has_security_group_logging(os_id): False [ 1406.704285] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.704533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.704533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.704698] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.704788] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.704974] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.705093] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.705156] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.705315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.705402] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.705646] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.705748] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.705812] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.705955] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.706049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.706245] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.706339] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.706398] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.706536] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.706608] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.706691] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d5014c2-302f-4390-94a8-c6bb31af6e0a is going to be created. [ 1406.771571] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.771811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.771811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.771995] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.772240] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.782504] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d5014c2-302f-4390-94a8-c6bb31af6e0a in Status: IN_PROGRESS for 2s [ 1407.108719] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1407.108932] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1408.796057] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d5014c2-302f-4390-94a8-c6bb31af6e0a in Status: SUCCESS [ 1408.796541] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.057449] env[69920]: INFO networking_nsxv3.common.synchronization [req-799de37c-6671-4b63-a21a-01d63b3b69bd req-1fd28622-ca41-4dee-81ce-b98bf7c953e6 tempest-ServerPasswordTestJSON-1224543486 tempest-ServerPasswordTestJSON-1224543486-project-member] Enqueued Resource ID: 5d5014c2-302f-4390-94a8-c6bb31af6e0a with Priority: HIGHEST for action security_group_members [ 1412.057449] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d5014c2-302f-4390-94a8-c6bb31af6e0a with Priority: HIGHEST for action security_group_members [ 1412.057449] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d5014c2-302f-4390-94a8-c6bb31af6e0a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.057733] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.057733] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.057733] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.057929] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.057994] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.058050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.058166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.059414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.059414] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d5014c2-302f-4390-94a8-c6bb31af6e0a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.560260] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.560424] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.560476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.560779] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.560907] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.561167] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.561262] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.561386] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.562038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.562038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.562038] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d5014c2-302f-4390-94a8-c6bb31af6e0a is going to be updated. [ 1412.592724] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.592940] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.592940] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.593176] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.593322] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.602853] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d5014c2-302f-4390-94a8-c6bb31af6e0a in Status: IN_PROGRESS for 2s [ 1414.613504] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d5014c2-302f-4390-94a8-c6bb31af6e0a in Status: SUCCESS [ 1414.613798] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d5014c2-302f-4390-94a8-c6bb31af6e0a deletion is rescheduled due to dependency. [ 1414.613798] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.058197] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1417.058603] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1422.059583] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1422.059583] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1427.060924] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1427.061373] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1431.864803] env[69920]: INFO networking_nsxv3.common.synchronization [req-b1334047-a8ea-4c32-b172-cd6dbc611b3d req-112c2bcf-4e0d-4e77-9a9d-a83c6d250ae7 tempest-ServerActionsTestJSON-2022006223 tempest-ServerActionsTestJSON-2022006223-project-member] Enqueued Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_members [ 1431.865349] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_members [ 1431.865653] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f35bb388-1251-4b12-b65e-3b2d1b58dda5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.865777] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.865845] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.866056] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.866224] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.866374] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.866411] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.866564] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.866657] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.866748] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1432.369659] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.369862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.369900] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.370148] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.370242] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.370459] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.370548] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.370607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.370766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.370843] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.370930] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 is going to be updated. [ 1432.398119] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.398356] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.398356] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.398521] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.398666] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.408371] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: IN_PROGRESS for 2s [ 1434.419320] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: SUCCESS [ 1434.419652] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 deletion is rescheduled due to dependency. [ 1434.419652] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.866875] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1436.866875] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1438.792821] env[69920]: INFO networking_nsxv3.common.synchronization [req-45fbd1c6-bf8b-411b-968e-2108c07ead4b req-7e2f9cb3-47b9-4a11-bb07-4185fc00e018 tempest-ServerActionsTestJSON-2022006223 tempest-ServerActionsTestJSON-2022006223-project-member] Enqueued Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_members [ 1438.793552] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_members [ 1438.793958] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f35bb388-1251-4b12-b65e-3b2d1b58dda5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.794136] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.794231] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.794528] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.794768] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1438.794998] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1438.794998] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1438.795224] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1438.795353] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1438.795479] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1439.056338] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-373 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.056534] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-373" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.056668] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-373" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.056951] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-373" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.057219] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.057379] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.057503] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.057724] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.057874] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.058232] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1439.058372] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1439.058491] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1439.058603] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1439.058718] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1439.058830] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1439.058969] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1439.077978] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1439.078171] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1439.078312] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1439.078486] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-373" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.078794] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-58b7f909-34e0-488c-b45d-808eea3e0be8 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.078967] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-58b7f909-34e0-488c-b45d-808eea3e0be8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.079120] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-58b7f909-34e0-488c-b45d-808eea3e0be8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.079450] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-58b7f909-34e0-488c-b45d-808eea3e0be8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.079605] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58b7f909-34e0-488c-b45d-808eea3e0be8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1439.298888] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.299069] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.299154] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.299444] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.299539] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.299743] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.299882] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.299973] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.300155] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.300237] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.300327] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 is going to be updated. [ 1439.328746] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.328915] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.328970] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.329168] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.329340] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.338077] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: IN_PROGRESS for 2s [ 1439.582480] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.582480] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.582699] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.582879] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.583061] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.583243] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 58b7f909-34e0-488c-b45d-808eea3e0be8 not found, creating... [ 1439.583507] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.583674] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.583801] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.584055] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.584209] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.584923] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.584923] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.584923] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.585151] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.585151] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.585267] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 58b7f909-34e0-488c-b45d-808eea3e0be8 is going to be created. [ 1439.609557] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.609777] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.609849] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.610151] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.610409] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.610655] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-58b7f909-34e0-488c-b45d-808eea3e0be8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.284128] env[69920]: INFO networking_nsxv3.common.synchronization [req-45fbd1c6-bf8b-411b-968e-2108c07ead4b req-68fef2fe-60be-4ef5-a340-6f41edc9a63c service nova] Enqueued Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_rules [ 1440.284357] env[69920]: INFO networking_nsxv3.common.synchronization [req-45fbd1c6-bf8b-411b-968e-2108c07ead4b req-68fef2fe-60be-4ef5-a340-6f41edc9a63c service nova] Enqueued Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_members [ 1440.284393] env[69920]: INFO networking_nsxv3.common.synchronization [req-45fbd1c6-bf8b-411b-968e-2108c07ead4b req-68fef2fe-60be-4ef5-a340-6f41edc9a63c service nova] Enqueued Resource ID: 58b7f909-34e0-488c-b45d-808eea3e0be8 with Priority: HIGHEST for action port [ 1440.284622] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_rules [ 1440.284751] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_members [ 1440.284846] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58b7f909-34e0-488c-b45d-808eea3e0be8 with Priority: HIGHEST for action port [ 1440.286424] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.286424] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.286424] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.286424] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.286632] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.287364] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f35bb388-1251-4b12-b65e-3b2d1b58dda5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.287470] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.287668] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-58b7f909-34e0-488c-b45d-808eea3e0be8 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.287769] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58b7f909-34e0-488c-b45d-808eea3e0be8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.287824] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58b7f909-34e0-488c-b45d-808eea3e0be8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.287999] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58b7f909-34e0-488c-b45d-808eea3e0be8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.288089] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58b7f909-34e0-488c-b45d-808eea3e0be8',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.790179] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f35bb388-1251-4b12-b65e-3b2d1b58dda5 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.790354] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.790446] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58b7f909-34e0-488c-b45d-808eea3e0be8 with status ACTIVE [ 1440.790619] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.790733] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.790806] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.791047] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.791138] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.791314] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.791431] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.791497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.791657] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.791752] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.791932] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.792035] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.792094] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.792231] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.792325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.792453] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58b7f909-34e0-488c-b45d-808eea3e0be8 is going to be updated. [ 1440.815412] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.815599] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.815641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.815827] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.815961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.816138] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58b7f909-34e0-488c-b45d-808eea3e0be8" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.349052] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: SUCCESS [ 1441.349052] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 deletion is rescheduled due to dependency. [ 1441.349052] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.349602] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.349826] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.350016] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.350135] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.350197] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.350359] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.350441] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.350535] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1441.852518] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1442.355119] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1442.858060] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.858222] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.858318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.858515] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.858635] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.858723] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 is going to be updated. [ 1442.888953] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1442.889169] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1442.889169] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1442.889385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1442.889526] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1442.899377] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: IN_PROGRESS for 2s [ 1444.910780] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: SUCCESS [ 1444.911155] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.911250] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.911568] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.911798] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1444.911946] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1444.912056] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1444.912240] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1444.912339] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.912459] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1444.912560] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1445.285474] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1445.285639] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1445.415332] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1445.917887] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f35bb388-1251-4b12-b65e-3b2d1b58dda5: rpc.has_security_group_logging(os_id): False [ 1445.937398] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.937615] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.937711] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.937963] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.938074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.938324] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1445.938422] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1445.938492] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1445.938655] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1445.938727] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.938815] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 is going to be updated. [ 1446.005481] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.005725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.005725] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.005903] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.006065] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.022738] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: IN_PROGRESS for 2s [ 1448.038457] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: SUCCESS [ 1448.038789] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.286392] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1450.286737] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1455.287918] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1455.288288] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1460.288893] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1460.289250] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1465.290469] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1465.290926] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1470.292159] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1470.292507] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1475.293463] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1475.293828] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1480.294798] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1480.295252] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1485.295794] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1485.296135] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1490.297472] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1490.297926] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1495.298274] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1495.298612] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1496.768394] env[69920]: INFO networking_nsxv3.common.synchronization [req-4acc3bb6-4ec8-4d4e-b2fd-b58666250d6b req-7cfab6ad-81cf-4763-9cc6-be24b4a9041e tempest-ServerActionsTestOtherA-296658517 tempest-ServerActionsTestOtherA-296658517-project-member] Enqueued Resource ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a with Priority: HIGHEST for action security_group_members [ 1496.768394] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a with Priority: HIGHEST for action security_group_members [ 1496.768636] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff58ec7f-6e34-4927-96bc-f7b93587dd0a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.768766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.768833] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.769168] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.769332] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1496.769439] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1496.769500] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1496.769656] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1496.769747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1496.769841] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff58ec7f-6e34-4927-96bc-f7b93587dd0a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1497.271825] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.272043] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.272131] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.272332] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.272430] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.272626] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.272726] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.272787] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.272942] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.273107] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.273169] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a is going to be updated. [ 1497.301747] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1497.302033] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1497.302033] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1497.302239] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1497.302383] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1497.325297] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a in Status: IN_PROGRESS for 2s [ 1499.337535] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a in Status: SUCCESS [ 1499.337870] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a deletion is rescheduled due to dependency. [ 1499.337870] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1501.769768] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1501.770078] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1506.208803] env[69920]: INFO networking_nsxv3.common.synchronization [req-479a08e8-b9ca-4aa9-9947-d67a233c764b req-c3058487-0b94-4704-a6a3-5ec2d397ee8c tempest-ServerActionsTestOtherA-296658517 tempest-ServerActionsTestOtherA-296658517-project-member] Enqueued Resource ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d with Priority: HIGHEST for action security_group_members [ 1506.209333] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d with Priority: HIGHEST for action security_group_members [ 1506.209630] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.209764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.209837] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.210144] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.210334] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.210954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.210954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.210954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.210954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.210954] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe28dbbd-b7cc-4e07-960a-5aebbacb607d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1506.472052] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-26 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.472338] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.472490] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.472835] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.473148] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.473364] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.473493] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.473755] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.473935] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.474235] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1506.474391] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1506.474522] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1506.474670] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1506.474811] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1506.474939] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1506.475108] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1506.498040] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1506.498272] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1506.498454] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1506.498665] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.499033] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-961d8267-5b82-4297-96a8-4806c2f9d8a5 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.499243] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-961d8267-5b82-4297-96a8-4806c2f9d8a5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.499379] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-961d8267-5b82-4297-96a8-4806c2f9d8a5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.499737] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-961d8267-5b82-4297-96a8-4806c2f9d8a5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.499912] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('961d8267-5b82-4297-96a8-4806c2f9d8a5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1506.712635] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.712817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.712817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.713061] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.713142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.713336] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.713437] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.713498] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.713654] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.713731] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.713815] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d is going to be updated. [ 1506.737770] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1506.737945] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1506.737996] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1506.738173] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1506.738312] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1506.746249] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d in Status: IN_PROGRESS for 2s [ 1507.002232] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.002490] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.002628] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.002919] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.003096] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.003763] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 961d8267-5b82-4297-96a8-4806c2f9d8a5 not found, creating... [ 1507.003763] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.003763] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.003987] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.004130] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.004285] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.004557] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.004722] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.004857] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.005374] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.005374] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.005466] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 961d8267-5b82-4297-96a8-4806c2f9d8a5 is going to be created. [ 1507.025442] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.025666] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.025775] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.026059] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.026300] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.026531] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-961d8267-5b82-4297-96a8-4806c2f9d8a5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1507.909332] env[69920]: INFO networking_nsxv3.common.synchronization [req-479a08e8-b9ca-4aa9-9947-d67a233c764b req-f1a7f54a-42ad-4ba5-b9a5-6d8aee5b5f2f service nova] Enqueued Resource ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d with Priority: HIGHEST for action security_group_rules [ 1507.909580] env[69920]: INFO networking_nsxv3.common.synchronization [req-479a08e8-b9ca-4aa9-9947-d67a233c764b req-f1a7f54a-42ad-4ba5-b9a5-6d8aee5b5f2f service nova] Enqueued Resource ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d with Priority: HIGHEST for action security_group_members [ 1507.909661] env[69920]: INFO networking_nsxv3.common.synchronization [req-479a08e8-b9ca-4aa9-9947-d67a233c764b req-f1a7f54a-42ad-4ba5-b9a5-6d8aee5b5f2f service nova] Enqueued Resource ID: 961d8267-5b82-4297-96a8-4806c2f9d8a5 with Priority: HIGHEST for action port [ 1507.910446] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d with Priority: HIGHEST for action security_group_rules [ 1507.910590] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d with Priority: HIGHEST for action security_group_members [ 1507.910689] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 961d8267-5b82-4297-96a8-4806c2f9d8a5 with Priority: HIGHEST for action port [ 1507.910963] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe28dbbd-b7cc-4e07-960a-5aebbacb607d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.911099] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.911178] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.911930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.911930] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe28dbbd-b7cc-4e07-960a-5aebbacb607d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1507.912300] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.912393] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.912584] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-961d8267-5b82-4297-96a8-4806c2f9d8a5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1507.912682] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-961d8267-5b82-4297-96a8-4806c2f9d8a5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1507.912747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-961d8267-5b82-4297-96a8-4806c2f9d8a5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1507.912907] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-961d8267-5b82-4297-96a8-4806c2f9d8a5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1507.912986] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('961d8267-5b82-4297-96a8-4806c2f9d8a5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.415411] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.415546] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.415686] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 961d8267-5b82-4297-96a8-4806c2f9d8a5 with status ACTIVE [ 1508.415854] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.415953] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.416038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.416244] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.416338] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.416508] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.416602] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.416664] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.416822] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.416898] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.417085] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.417180] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.417242] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.417383] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.417463] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.417540] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 961d8267-5b82-4297-96a8-4806c2f9d8a5 is going to be updated. [ 1508.438037] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.438230] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.438266] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.438464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.438601] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.438756] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-961d8267-5b82-4297-96a8-4806c2f9d8a5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.756173] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d in Status: SUCCESS [ 1508.756393] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d deletion is rescheduled due to dependency. [ 1508.756494] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.756607] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.756830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.757030] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.757147] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.757214] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.757372] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.757454] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.757549] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe28dbbd-b7cc-4e07-960a-5aebbacb607d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.259716] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe28dbbd-b7cc-4e07-960a-5aebbacb607d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.761923] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe28dbbd-b7cc-4e07-960a-5aebbacb607d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1510.264835] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.265155] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.265155] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.265310] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.265392] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.265498] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d is going to be updated. [ 1510.291755] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.291991] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.291991] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.292220] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.292368] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.299998] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d in Status: IN_PROGRESS for 2s [ 1512.312079] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d in Status: SUCCESS [ 1512.312079] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.312079] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.312561] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.312561] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.312745] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.312745] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.312975] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.313108] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.313249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.313380] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe28dbbd-b7cc-4e07-960a-5aebbacb607d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.815596] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.815796] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.815866] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.816100] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.816346] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.816476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.816553] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.816780] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.816874] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.816965] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.817134] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.817230] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.817294] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.817444] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.817584] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.817679] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.817739] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.817879] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.817961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.818170] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.818170] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe28dbbd-b7cc-4e07-960a-5aebbacb607d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.912131] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1512.912304] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1513.320394] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe28dbbd-b7cc-4e07-960a-5aebbacb607d: rpc.has_security_group_logging(os_id): False [ 1513.337702] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.337890] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.337937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.338137] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.338236] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.338475] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.338586] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.338633] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.338793] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.338872] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.339095] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.339191] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.339251] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.339392] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.339468] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.339646] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.339741] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.339801] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.339941] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.340026] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.340148] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d is going to be updated. [ 1513.396071] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.396280] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.396280] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.396460] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.396606] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.407401] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d in Status: IN_PROGRESS for 2s [ 1515.423096] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d in Status: SUCCESS [ 1515.423457] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.254999] env[69920]: INFO networking_nsxv3.common.synchronization [req-803fb33c-5db6-4e49-8175-d8cee2801b80 req-9fa3dd32-33a3-4be0-9e48-3d76daa46f87 tempest-ServerActionsTestOtherA-296658517 tempest-ServerActionsTestOtherA-296658517-project-member] Enqueued Resource ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d with Priority: HIGHEST for action security_group_members [ 1517.255528] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d with Priority: HIGHEST for action security_group_members [ 1517.255824] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.255942] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.256036] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.256350] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.256509] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.256611] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.256675] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.256826] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.256916] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.257020] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe28dbbd-b7cc-4e07-960a-5aebbacb607d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1517.342753] env[69920]: INFO networking_nsxv3.common.synchronization [req-803fb33c-5db6-4e49-8175-d8cee2801b80 req-9fa3dd32-33a3-4be0-9e48-3d76daa46f87 tempest-ServerActionsTestOtherA-296658517 tempest-ServerActionsTestOtherA-296658517-project-member] Enqueued Resource ID: 961d8267-5b82-4297-96a8-4806c2f9d8a5 with Priority: HIGHEST for action port [ 1517.343369] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 961d8267-5b82-4297-96a8-4806c2f9d8a5 with Priority: HIGHEST for action port [ 1517.343694] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-961d8267-5b82-4297-96a8-4806c2f9d8a5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.343858] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-961d8267-5b82-4297-96a8-4806c2f9d8a5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.343910] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-961d8267-5b82-4297-96a8-4806c2f9d8a5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.344166] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-961d8267-5b82-4297-96a8-4806c2f9d8a5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.344249] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('961d8267-5b82-4297-96a8-4806c2f9d8a5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1517.761439] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.761439] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.761439] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.761439] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.761439] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.761439] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.761439] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.761439] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.761439] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.761439] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.761439] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d is going to be updated. [ 1517.793442] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.793584] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.793686] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.793902] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.794064] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.802700] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d in Status: IN_PROGRESS for 2s [ 1517.846236] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 961d8267-5b82-4297-96a8-4806c2f9d8a5 with status ACTIVE [ 1517.846487] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.846628] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.846704] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.846954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.847066] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.847254] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.847370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.847422] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.847571] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.847653] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.847833] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.847929] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.847993] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.848219] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.848308] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.848441] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 961d8267-5b82-4297-96a8-4806c2f9d8a5 is going to be updated. [ 1517.868282] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.868487] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.868541] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.868745] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.868881] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.869059] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-961d8267-5b82-4297-96a8-4806c2f9d8a5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1519.812876] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d in Status: SUCCESS [ 1519.813251] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d deletion is rescheduled due to dependency. [ 1519.813251] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.344672] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1522.345063] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1524.421074] env[69920]: INFO networking_nsxv3.common.synchronization [req-17e2839a-158e-443b-8edb-f789e5bfd02a req-0b96932c-56f2-458a-90e4-7d602a825f77 tempest-ServerActionsTestJSON-2022006223 tempest-ServerActionsTestJSON-2022006223-project-member] Enqueued Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_members [ 1524.421793] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_members [ 1524.422098] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f35bb388-1251-4b12-b65e-3b2d1b58dda5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.422228] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.422329] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.422508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.422658] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.422747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.423504] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.423504] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.423504] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.423504] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.925344] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.925514] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.925570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.925785] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.925879] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.926240] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.926240] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.926240] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.926475] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.926535] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.926627] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 is going to be updated. [ 1524.953784] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.954070] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.954070] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.954201] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.954346] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.962470] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: IN_PROGRESS for 2s [ 1526.974999] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: SUCCESS [ 1526.975378] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 deletion is rescheduled due to dependency. [ 1526.975378] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1529.422586] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1529.422966] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1533.614154] env[69920]: INFO networking_nsxv3.common.synchronization [req-b202a276-2835-442b-b4fe-79c88cc2641d req-3ec2aedd-3d7a-4089-99e8-9ee6761722a1 tempest-ServerActionsTestJSON-2022006223 tempest-ServerActionsTestJSON-2022006223-project-member] Enqueued Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_members [ 1533.614799] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_members [ 1533.615119] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f35bb388-1251-4b12-b65e-3b2d1b58dda5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.615246] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.615312] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.615509] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.615659] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.615759] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.615820] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.615970] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.616067] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.616296] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1533.894316] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-373 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.894516] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-373" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.894650] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-373" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.894930] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-373" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.895210] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.895458] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.895604] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.895831] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.895986] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.896237] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1533.896358] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1533.896477] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1533.896594] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1533.896723] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1533.896877] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1533.897035] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1533.917339] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1533.917570] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1533.917662] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1533.917846] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-373" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.918182] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-4c7c3743-a31a-4f05-9380-5e133b888b77 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1533.918361] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-4c7c3743-a31a-4f05-9380-5e133b888b77" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1533.918486] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-4c7c3743-a31a-4f05-9380-5e133b888b77" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1533.918841] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-4c7c3743-a31a-4f05-9380-5e133b888b77" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1533.919012] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c7c3743-a31a-4f05-9380-5e133b888b77',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1534.118109] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.118297] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.118333] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.118594] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.118657] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.118837] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.118950] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.119023] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.119185] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.119266] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.119353] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 is going to be updated. [ 1534.146542] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.146700] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.146700] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.146949] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.147097] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.155983] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: IN_PROGRESS for 2s [ 1534.421743] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.421996] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.422079] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.422361] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.422589] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.422770] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port 4c7c3743-a31a-4f05-9380-5e133b888b77 not found, creating... [ 1534.423055] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.423226] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.423352] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.423585] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.423733] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.424030] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.424196] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.424322] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.424543] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.424685] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.424833] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: 4c7c3743-a31a-4f05-9380-5e133b888b77 is going to be created. [ 1534.444884] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1534.445150] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1534.445262] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1534.445548] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1534.445786] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1534.446034] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-4c7c3743-a31a-4f05-9380-5e133b888b77" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.129362] env[69920]: INFO networking_nsxv3.common.synchronization [req-b202a276-2835-442b-b4fe-79c88cc2641d req-f0460fc5-0cf0-48aa-ab97-c716cc1dc7e2 service nova] Enqueued Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_rules [ 1535.129613] env[69920]: INFO networking_nsxv3.common.synchronization [req-b202a276-2835-442b-b4fe-79c88cc2641d req-f0460fc5-0cf0-48aa-ab97-c716cc1dc7e2 service nova] Enqueued Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_members [ 1535.129699] env[69920]: INFO networking_nsxv3.common.synchronization [req-b202a276-2835-442b-b4fe-79c88cc2641d req-f0460fc5-0cf0-48aa-ab97-c716cc1dc7e2 service nova] Enqueued Resource ID: 4c7c3743-a31a-4f05-9380-5e133b888b77 with Priority: HIGHEST for action port [ 1535.130220] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_rules [ 1535.130370] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_members [ 1535.130469] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c7c3743-a31a-4f05-9380-5e133b888b77 with Priority: HIGHEST for action port [ 1535.130739] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.130991] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.130991] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.131142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.131224] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.132195] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f35bb388-1251-4b12-b65e-3b2d1b58dda5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.132195] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.132344] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c7c3743-a31a-4f05-9380-5e133b888b77 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.132492] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c7c3743-a31a-4f05-9380-5e133b888b77" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.132559] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c7c3743-a31a-4f05-9380-5e133b888b77" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.132801] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c7c3743-a31a-4f05-9380-5e133b888b77" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.132801] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c7c3743-a31a-4f05-9380-5e133b888b77',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1535.634608] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f35bb388-1251-4b12-b65e-3b2d1b58dda5 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.634766] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.634967] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c7c3743-a31a-4f05-9380-5e133b888b77 with status ACTIVE [ 1535.635162] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.635270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.635335] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.635549] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.635641] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.635808] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.635906] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.635969] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.636142] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.636220] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.636394] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.636488] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.636548] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.636688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.636754] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.636839] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c7c3743-a31a-4f05-9380-5e133b888b77 is going to be updated. [ 1535.659513] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1535.659666] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1535.659733] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1535.659943] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1535.660099] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1535.660262] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c7c3743-a31a-4f05-9380-5e133b888b77" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.165922] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: SUCCESS [ 1536.166143] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 deletion is rescheduled due to dependency. [ 1536.166238] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.166401] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.166649] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.166834] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1536.166945] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1536.167016] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1536.167174] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1536.167257] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1536.167350] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1536.669418] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1537.171684] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1537.673797] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.673958] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.674041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.674255] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.674345] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.674540] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 is going to be updated. [ 1537.703114] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1537.703114] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1537.703114] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1537.703516] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1537.703516] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1537.712933] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: IN_PROGRESS for 2s [ 1539.723147] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: SUCCESS [ 1539.723508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.723508] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.723688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.723874] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1539.724036] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1539.724111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1539.724270] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1539.724353] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.724439] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1539.724530] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1540.131203] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1540.131413] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1540.227294] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1540.730482] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f35bb388-1251-4b12-b65e-3b2d1b58dda5: rpc.has_security_group_logging(os_id): False [ 1540.748124] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.748320] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.748369] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.748574] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.748670] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.748985] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.749108] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.749175] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.749337] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.749416] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.749506] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 is going to be updated. [ 1540.805796] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1540.806022] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1540.806084] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1540.806287] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1540.806442] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1540.818657] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: IN_PROGRESS for 2s [ 1541.650572] env[69920]: INFO networking_nsxv3.common.synchronization [req-5c96df9d-0556-4acf-a841-8d8562b93fea req-add22a30-b929-4178-8f2c-e50df4756107 tempest-ServerActionsTestOtherA-296658517 tempest-ServerActionsTestOtherA-296658517-project-member] Enqueued Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGHEST for action security_group_members [ 1541.651096] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGHEST for action security_group_members [ 1541.651400] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-21459423-ae1a-4ef3-b1fd-549e38f9136d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.651522] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.651592] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.651792] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.651940] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.652060] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.652126] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.652280] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.652366] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.652506] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1541.944554] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock network-26 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.945069] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "network-26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.945069] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "network-26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.945331] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "network-26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.945611] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.945860] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.946148] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.946325] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.946485] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.946709] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1541.946829] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] NeedRegenerationException {{(pid=69920) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1541.946945] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] no value, waiting for create lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1541.947099] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] value creation lock acquired {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1541.947278] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] No value present for key: 'zone-id' {{(pid=69920) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1541.947401] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Calling creation function for not-yet-present value {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1541.947547] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1541.968420] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1541.968778] env[69920]: DEBUG dogpile.cache.region [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69920) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1541.968998] env[69920]: DEBUG dogpile.lock [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Released creation lock {{(pid=69920) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1541.969325] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "network-26" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1541.969698] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock port-e8e1098c-fb9a-4eef-8751-2a7e610d3b71 taken with stack trace [, , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1541.969887] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "port-e8e1098c-fb9a-4eef-8751-2a7e610d3b71" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1541.970030] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "port-e8e1098c-fb9a-4eef-8751-2a7e610d3b71" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1541.970451] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "port-e8e1098c-fb9a-4eef-8751-2a7e610d3b71" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1541.970636] env[69920]: DEBUG networking_nsxv3.api.rpc [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8e1098c-fb9a-4eef-8751-2a7e610d3b71',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1542.155049] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1542.474879] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.475272] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.475528] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.475912] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.476203] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.476492] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Segment Port e8e1098c-fb9a-4eef-8751-2a7e610d3b71 not found, creating... [ 1542.477405] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.477691] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.478565] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.478922] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.480531] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.481045] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.481530] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.481754] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.482068] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.482328] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.483841] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Resource: SegmentPort with ID: e8e1098c-fb9a-4eef-8751-2a7e610d3b71 is going to be created. [ 1542.510138] env[69920]: DEBUG networking_nsxv3.common.locking [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1542.510553] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1542.510848] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1542.511266] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1542.511585] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.511918] env[69920]: DEBUG oslo_concurrency.lockutils [None req-7dbb3e61-5a72-46bd-8d63-bd09ffcdc668 None None] Releasing lock "port-e8e1098c-fb9a-4eef-8751-2a7e610d3b71" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1542.656983] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1542.831335] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: SUCCESS [ 1542.831622] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.159886] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.160232] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.160232] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.160331] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.160418] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.160517] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d is going to be updated. [ 1543.180246] env[69920]: INFO networking_nsxv3.common.synchronization [req-5c96df9d-0556-4acf-a841-8d8562b93fea req-f4593b22-db26-4745-9b5f-fc08adbebaa0 service nova] Enqueued Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGHEST for action security_group_rules [ 1543.180427] env[69920]: INFO networking_nsxv3.common.synchronization [req-5c96df9d-0556-4acf-a841-8d8562b93fea req-f4593b22-db26-4745-9b5f-fc08adbebaa0 service nova] Enqueued Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGHEST for action security_group_members [ 1543.180613] env[69920]: INFO networking_nsxv3.common.synchronization [req-5c96df9d-0556-4acf-a841-8d8562b93fea req-f4593b22-db26-4745-9b5f-fc08adbebaa0 service nova] Enqueued Resource ID: e8e1098c-fb9a-4eef-8751-2a7e610d3b71 with Priority: HIGHEST for action port [ 1543.180822] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGHEST for action security_group_rules [ 1543.180957] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGHEST for action security_group_members [ 1543.181070] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8e1098c-fb9a-4eef-8751-2a7e610d3b71 with Priority: HIGHEST for action port [ 1543.181622] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21459423-ae1a-4ef3-b1fd-549e38f9136d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.181745] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.181817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.182150] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.182254] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1543.183227] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-21459423-ae1a-4ef3-b1fd-549e38f9136d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.183335] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.183621] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8e1098c-fb9a-4eef-8751-2a7e610d3b71 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.183752] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8e1098c-fb9a-4eef-8751-2a7e610d3b71" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.183819] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8e1098c-fb9a-4eef-8751-2a7e610d3b71" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.184018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8e1098c-fb9a-4eef-8751-2a7e610d3b71" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.184130] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8e1098c-fb9a-4eef-8751-2a7e610d3b71',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1543.192364] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.192609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.192643] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.192862] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.193034] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.203173] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d in Status: IN_PROGRESS for 2s [ 1543.685771] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-21459423-ae1a-4ef3-b1fd-549e38f9136d taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.685993] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.694183] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e8e1098c-fb9a-4eef-8751-2a7e610d3b71 with status ACTIVE [ 1543.694530] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.694666] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.694736] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.694952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.695128] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.695249] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.695392] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.695484] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.695702] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.695811] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.696014] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.696116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.696173] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.696320] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.696394] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.696493] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e8e1098c-fb9a-4eef-8751-2a7e610d3b71 is going to be updated. [ 1543.720703] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1543.720943] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1543.720943] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1543.721110] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1543.721188] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1543.721348] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8e1098c-fb9a-4eef-8751-2a7e610d3b71" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.212722] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d in Status: SUCCESS [ 1545.213111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.213111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.213311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.213516] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1545.213646] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1545.213717] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1545.213880] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1545.213965] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1545.214079] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1545.716706] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.219037] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1546.721639] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.721860] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.721976] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.722319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.722487] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.722634] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d is going to be updated. [ 1546.754982] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1546.755218] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1546.755277] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1546.755559] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1546.755764] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1546.765899] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d in Status: IN_PROGRESS for 2s [ 1548.182785] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1548.183237] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1548.776862] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d in Status: SUCCESS [ 1548.777124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.777303] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.777535] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.777725] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1548.777842] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1548.777905] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1548.778073] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1548.778157] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.778242] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1548.778331] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.281025] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.784253] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21459423-ae1a-4ef3-b1fd-549e38f9136d: rpc.has_security_group_logging(os_id): False [ 1549.801786] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.801786] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.802037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.802074] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.802168] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.802451] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.802605] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.802854] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.802854] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.802916] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.802980] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d is going to be updated. [ 1549.858431] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.858648] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.858648] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.858837] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.858981] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.872211] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d in Status: IN_PROGRESS for 2s [ 1551.886642] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d in Status: SUCCESS [ 1551.886985] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.184333] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1553.184641] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1558.185965] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1558.186394] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1561.179926] env[69920]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1561.179926] env[69920]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-8dc293fb-c591-420b-b413-20ac5e6609fb None None] NSXv3 Agent Agent loop - iteration:4 started [ 1563.187547] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1563.187930] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1567.117152] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1567.117458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1567.117458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1567.117615] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1567.117722] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1567.622077] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.125224] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1568.188382] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1568.188382] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1568.627753] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1568.627753] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1569.387869] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.390018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.390018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.390018] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.402645] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1569.403714] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.404660] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1569.443805] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.444265] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.444464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.444784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.468865] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.470041] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1569.470188] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1569.470352] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1569.510055] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.510324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.510324] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.510481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.511348] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.511518] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1569.584213] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.584415] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.584415] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.584629] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.584952] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.585281] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1569.659204] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.659436] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.659436] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.659602] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.659937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.660322] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:32. [ 1569.660455] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'f35bb388-1251-4b12-b65e-3b2d1b58dda5', '0ae58702-5520-4afd-abbd-064c34515d9b', 'ff58ec7f-6e34-4927-96bc-f7b93587dd0a', '21459423-ae1a-4ef3-b1fd-549e38f9136d', 'fe28dbbd-b7cc-4e07-960a-5aebbacb607d', 'f396ecc9-2832-4971-bf67-f8c7289f9916', 'a9141c37-2b91-4c20-add2-e8a0090bfc23', 'fb749722-17ca-41f8-9be5-6aa59fad95b3', 'a7b62144-a34e-4e44-9dda-a1306bb3fa05', '48d70a54-3f5c-40ef-9cc4-f5d82c01a717', '8f8bd1f0-245d-4d6b-8841-4e7773984ffb', 'e31e2ae5-2f08-403b-b19a-697a36f3cb16', '26f7f40b-869b-4715-bb99-c61da31c1672', 'd76d1ef7-21d9-442e-8d89-3b9cfee5a4ac', 'ff50f1ab-6b6a-400e-a79f-0d29ae875687', '6440e2db-5336-4fd7-b450-468fa8f78560', 'c3844e5d-1857-4823-ae42-ffaed25f95f9', '361f5d4b-d775-40f2-9486-50f4511d4852', 'dd313130-fb41-4c30-96a8-0facc1385d33', '5d5014c2-302f-4390-94a8-c6bb31af6e0a', 'b3cdaff7-e960-4617-83ae-85aa804dab73', '154896d4-d0bc-49e9-8d89-5fcc04260b1a', '287306e2-c53f-4a5f-82ab-b97a6d8f9e37', 'd2ff1e5d-d0c8-419d-bc14-18543641dd30', '5a8bd4df-a8df-4d64-94ea-a00a62c48a01', '1712776d-764c-405e-85d0-105070b4c2e8', '25d6107d-095d-4250-920f-5b89f0d9b75b', 'a6054485-180a-4f29-a65a-3151187db51e', '394b8a58-53d4-4ddb-998c-b2810a22cd53', '215a1eaa-c047-4dab-aaf3-49d2cea752dc', '0a9f1a73-f43f-451c-8ce2-328d0b73b769', '156af133-c5cb-4af5-87be-b21d4422308a'} {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1569.660549] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1569.679866] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.680107] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.680107] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.680268] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.680355] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.680467] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1569.680538] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1569.680607] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1569.759197] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.759402] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.759402] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.759620] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.760873] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.761239] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1569.761325] env[69920]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69920) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1569.761404] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1569.761476] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1569.761567] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/32 resources of Type:Security Group Rules [ 1569.761643] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGH for action security_group_rules [ 1569.761724] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGH for action security_group_rules [ 1569.761794] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a with Priority: HIGH for action security_group_rules [ 1569.761862] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGH for action security_group_rules [ 1569.761928] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d with Priority: HIGH for action security_group_rules [ 1569.761994] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f396ecc9-2832-4971-bf67-f8c7289f9916 with Priority: HIGH for action security_group_rules [ 1569.762073] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 with Priority: HIGH for action security_group_rules [ 1569.762138] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fb749722-17ca-41f8-9be5-6aa59fad95b3 with Priority: HIGH for action security_group_rules [ 1569.762202] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a7b62144-a34e-4e44-9dda-a1306bb3fa05 with Priority: HIGH for action security_group_rules [ 1569.762268] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGH for action security_group_rules [ 1569.762333] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGH for action security_group_rules [ 1569.762405] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGH for action security_group_rules [ 1569.762472] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 26f7f40b-869b-4715-bb99-c61da31c1672 with Priority: HIGH for action security_group_rules [ 1569.762538] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac with Priority: HIGH for action security_group_rules [ 1569.762604] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 with Priority: HIGH for action security_group_rules [ 1569.762668] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6440e2db-5336-4fd7-b450-468fa8f78560 with Priority: HIGH for action security_group_rules [ 1569.762734] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c3844e5d-1857-4823-ae42-ffaed25f95f9 with Priority: HIGH for action security_group_rules [ 1569.762832] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 361f5d4b-d775-40f2-9486-50f4511d4852 with Priority: HIGH for action security_group_rules [ 1569.762913] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGH for action security_group_rules [ 1569.762980] env[69920]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5d5014c2-302f-4390-94a8-c6bb31af6e0a with Priority: HIGH for action security_group_rules [ 1569.763095] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.190087] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1573.190469] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1573.190469] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGH for action security_group_rules [ 1573.190469] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a with Priority: HIGH for action security_group_rules [ 1573.190469] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 with Priority: HIGH for action security_group_rules [ 1573.190614] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 with Priority: HIGH for action security_group_rules [ 1573.190649] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d5014c2-302f-4390-94a8-c6bb31af6e0a with Priority: HIGH for action security_group_rules [ 1573.190735] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd313130-fb41-4c30-96a8-0facc1385d33 with Priority: HIGH for action security_group_rules [ 1573.190843] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 361f5d4b-d775-40f2-9486-50f4511d4852 with Priority: HIGH for action security_group_rules [ 1573.190954] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3844e5d-1857-4823-ae42-ffaed25f95f9 with Priority: HIGH for action security_group_rules [ 1573.191055] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac with Priority: HIGH for action security_group_rules [ 1573.191161] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6440e2db-5336-4fd7-b450-468fa8f78560 with Priority: HIGH for action security_group_rules [ 1573.191226] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26f7f40b-869b-4715-bb99-c61da31c1672 with Priority: HIGH for action security_group_rules [ 1573.191313] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 with Priority: HIGH for action security_group_rules [ 1573.191414] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb with Priority: HIGH for action security_group_rules [ 1573.191560] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 with Priority: HIGH for action security_group_rules [ 1573.191661] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7b62144-a34e-4e44-9dda-a1306bb3fa05 with Priority: HIGH for action security_group_rules [ 1573.191745] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f396ecc9-2832-4971-bf67-f8c7289f9916 with Priority: HIGH for action security_group_rules [ 1573.191854] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb749722-17ca-41f8-9be5-6aa59fad95b3 with Priority: HIGH for action security_group_rules [ 1573.191965] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d with Priority: HIGH for action security_group_rules [ 1573.192032] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ae58702-5520-4afd-abbd-064c34515d9b with Priority: HIGH for action security_group_rules [ 1573.192111] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGH for action security_group_rules [ 1573.192443] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.192568] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.192634] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.192868] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.192944] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.193916] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff58ec7f-6e34-4927-96bc-f7b93587dd0a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.194298] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.194376] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.194548] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.194625] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff58ec7f-6e34-4927-96bc-f7b93587dd0a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.195376] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9141c37-2b91-4c20-add2-e8a0090bfc23 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.195481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.195578] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.195868] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.195868] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9141c37-2b91-4c20-add2-e8a0090bfc23',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.196448] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff50f1ab-6b6a-400e-a79f-0d29ae875687 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.196550] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.196616] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.196859] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.196933] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff50f1ab-6b6a-400e-a79f-0d29ae875687',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.197904] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d5014c2-302f-4390-94a8-c6bb31af6e0a taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.197984] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.198066] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.198217] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.198296] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d5014c2-302f-4390-94a8-c6bb31af6e0a',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.198991] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd313130-fb41-4c30-96a8-0facc1385d33 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.199141] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.199211] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.199529] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.199606] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd313130-fb41-4c30-96a8-0facc1385d33',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.200394] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-361f5d4b-d775-40f2-9486-50f4511d4852 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.200491] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.200558] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.200711] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.200776] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('361f5d4b-d775-40f2-9486-50f4511d4852',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.201450] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3844e5d-1857-4823-ae42-ffaed25f95f9 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.201559] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.201620] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.201768] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.201842] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3844e5d-1857-4823-ae42-ffaed25f95f9',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.202588] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.202694] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.202762] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.202937] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.203040] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.203778] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6440e2db-5336-4fd7-b450-468fa8f78560 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.204089] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.204089] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.204159] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.204192] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6440e2db-5336-4fd7-b450-468fa8f78560',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.204928] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26f7f40b-869b-4715-bb99-c61da31c1672 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.205053] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.205114] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.205264] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.205340] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26f7f40b-869b-4715-bb99-c61da31c1672',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.205989] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.206116] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.206183] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.206394] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.206472] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e31e2ae5-2f08-403b-b19a-697a36f3cb16',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.207145] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8f8bd1f0-245d-4d6b-8841-4e7773984ffb taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.207249] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.207316] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.207464] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.207536] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8f8bd1f0-245d-4d6b-8841-4e7773984ffb',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.208509] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.208678] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.208678] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.208820] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.208892] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48d70a54-3f5c-40ef-9cc4-f5d82c01a717',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.209560] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7b62144-a34e-4e44-9dda-a1306bb3fa05 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.209665] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.209732] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.209877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.209951] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7b62144-a34e-4e44-9dda-a1306bb3fa05',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.210611] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f396ecc9-2832-4971-bf67-f8c7289f9916 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.210715] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.210783] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.210931] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.211009] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f396ecc9-2832-4971-bf67-f8c7289f9916',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.211740] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb749722-17ca-41f8-9be5-6aa59fad95b3 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.211851] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.211913] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.212085] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.212181] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb749722-17ca-41f8-9be5-6aa59fad95b3',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.212859] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe28dbbd-b7cc-4e07-960a-5aebbacb607d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.212965] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.213044] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.213239] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.213276] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe28dbbd-b7cc-4e07-960a-5aebbacb607d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.213910] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ae58702-5520-4afd-abbd-064c34515d9b taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.214033] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.214102] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.214248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.214367] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ae58702-5520-4afd-abbd-064c34515d9b',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.214950] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21459423-ae1a-4ef3-b1fd-549e38f9136d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.215084] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.215136] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.215276] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.215345] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.251131] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.251392] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.251392] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.251524] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.253289] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.253414] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.254130] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.254259] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.254898] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.254992] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.255683] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.255773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.275544] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.275737] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff58ec7f-6e34-4927-96bc-f7b93587dd0a is going to be deleted. [ 1573.276783] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.277036] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.294702] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.294840] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9141c37-2b91-4c20-add2-e8a0090bfc23 is going to be deleted. [ 1573.295676] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.295883] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.317283] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.317447] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d5014c2-302f-4390-94a8-c6bb31af6e0a is going to be deleted. [ 1573.318385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.318632] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.339149] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.339303] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6440e2db-5336-4fd7-b450-468fa8f78560 is going to be deleted. [ 1573.340175] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.340384] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.341779] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.341900] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.342977] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.343115] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.363842] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.364029] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.375559] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.375717] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff50f1ab-6b6a-400e-a79f-0d29ae875687 is going to be deleted. [ 1573.376560] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.376762] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.376867] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.377011] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff58ec7f-6e34-4927-96bc-f7b93587dd0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.377171] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.377330] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.377412] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.377518] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9141c37-2b91-4c20-add2-e8a0090bfc23" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.377989] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.378165] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.378248] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.378359] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d5014c2-302f-4390-94a8-c6bb31af6e0a" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.465523] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.465733] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.465733] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.465901] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.465996] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.466141] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6440e2db-5336-4fd7-b450-468fa8f78560" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.496076] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.496325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.496433] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.496758] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.496919] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.497124] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff50f1ab-6b6a-400e-a79f-0d29ae875687" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.717406] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f35bb388-1251-4b12-b65e-3b2d1b58dda5 taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.717561] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.717629] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.717830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.717993] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.718103] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.718173] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.718315] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.718404] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.718491] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.718578] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.732534] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-21459423-ae1a-4ef3-b1fd-549e38f9136d taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.732778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.732778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.732958] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.733134] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.733232] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.733302] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.733440] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.733525] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.733612] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.733695] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1573.758550] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.758748] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.758748] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.759657] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.760890] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.761228] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.779656] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.779897] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.781233] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.781393] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.782015] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.782177] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.782841] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.782957] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.783653] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.783750] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.784453] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.784532] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.785290] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.785383] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.785724] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.785808] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.786544] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.786636] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.787231] env[69920]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1573.787718] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.787718] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.788284] env[69920]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1573.788690] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.788778] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.789454] env[69920]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1573.789797] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.789922] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e31e2ae5-2f08-403b-b19a-697a36f3cb16 is going to be deleted. [ 1573.791113] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.791327] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.814055] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.814055] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26f7f40b-869b-4715-bb99-c61da31c1672 is going to be deleted. [ 1573.814930] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.815157] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.835316] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.835525] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f396ecc9-2832-4971-bf67-f8c7289f9916 is going to be deleted. [ 1573.836408] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.836673] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.852353] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.852494] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.858317] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.858458] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb749722-17ca-41f8-9be5-6aa59fad95b3 is going to be deleted. [ 1573.859365] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.859576] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.882258] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.882388] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.892233] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.892371] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd313130-fb41-4c30-96a8-0facc1385d33 is going to be deleted. [ 1573.893282] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.893497] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.894852] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.894954] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.937640] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1573.937830] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1573.938597] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.938718] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe28dbbd-b7cc-4e07-960a-5aebbacb607d is going to be deleted. [ 1573.939575] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.939854] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1573.968265] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1573.968467] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ae58702-5520-4afd-abbd-064c34515d9b is going to be deleted. [ 1573.969281] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1573.969506] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.012260] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.012458] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.014037] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.014211] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3844e5d-1857-4823-ae42-ffaed25f95f9 is going to be deleted. [ 1574.015098] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.015318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.068247] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.068446] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.070431] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.070561] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8f8bd1f0-245d-4d6b-8841-4e7773984ffb is going to be deleted. [ 1574.071482] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.071714] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.094197] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.094450] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.122591] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.122759] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 361f5d4b-d775-40f2-9486-50f4511d4852 is going to be deleted. [ 1574.123749] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.124038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.181341] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.181492] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7b62144-a34e-4e44-9dda-a1306bb3fa05 is going to be deleted. [ 1574.182405] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.182632] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.184115] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.184228] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.222340] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1574.224849] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.224849] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.231545] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.231707] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.242058] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1574.265589] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.265759] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac is going to be deleted. [ 1574.266631] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.266847] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.300058] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.300254] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.343722] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.343929] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48d70a54-3f5c-40ef-9cc4-f5d82c01a717 is going to be deleted. [ 1574.344835] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.345075] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.345189] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.345325] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e31e2ae5-2f08-403b-b19a-697a36f3cb16" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.345479] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.345645] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.345728] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.345844] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26f7f40b-869b-4715-bb99-c61da31c1672" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.346370] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.346530] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.346627] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.346752] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f396ecc9-2832-4971-bf67-f8c7289f9916" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.346884] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.347041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.347118] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.347232] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb749722-17ca-41f8-9be5-6aa59fad95b3" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.347362] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.347505] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.347580] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.347691] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe28dbbd-b7cc-4e07-960a-5aebbacb607d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.347820] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.347961] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.348050] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.348163] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd313130-fb41-4c30-96a8-0facc1385d33" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.348289] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.348426] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.348502] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.348609] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ae58702-5520-4afd-abbd-064c34515d9b" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.348731] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.348867] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.348938] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.349057] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3844e5d-1857-4823-ae42-ffaed25f95f9" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.349183] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.349319] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.349385] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.349492] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8f8bd1f0-245d-4d6b-8841-4e7773984ffb" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.349611] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.349747] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.349813] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.349925] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-361f5d4b-d775-40f2-9486-50f4511d4852" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.350096] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.350239] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.350311] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.350417] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7b62144-a34e-4e44-9dda-a1306bb3fa05" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.351737] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.351864] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.351919] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.352071] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.352152] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.352262] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d76d1ef7-21d9-442e-8d89-3b9cfee5a4ac" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.483891] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.484192] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.484192] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.484264] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.484351] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.484476] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48d70a54-3f5c-40ef-9cc4-f5d82c01a717" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.724854] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f35bb388-1251-4b12-b65e-3b2d1b58dda5: rpc.has_security_group_logging(os_id): False [ 1574.743197] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.743395] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.743395] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.743563] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.744647] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21459423-ae1a-4ef3-b1fd-549e38f9136d: rpc.has_security_group_logging(os_id): False [ 1574.760474] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.760682] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.765041] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.765311] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.765423] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.765481] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.765675] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.765759] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.765830] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 is going to be updated. [ 1574.766817] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.766987] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.794973] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.795303] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.795422] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.795477] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.795681] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.795761] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.795850] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d is going to be updated. [ 1574.836884] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.837111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.837111] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.837318] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.837466] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.853383] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1574.853614] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1574.853614] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1574.853784] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1574.853996] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.860117] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: IN_PROGRESS for 2s [ 1574.871975] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d in Status: IN_PROGRESS for 2s [ 1576.875807] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: SUCCESS [ 1576.876309] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1576.882761] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d in Status: SUCCESS [ 1576.882983] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1578.193593] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1578.193965] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1583.195265] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1583.195619] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1588.196317] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1588.196717] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1593.198123] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1593.198474] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1596.217932] env[69920]: INFO networking_nsxv3.common.synchronization [req-ff1d880a-f1a6-4e9a-bfdb-8cb2440cf1f6 req-9e77d8ba-182d-4ca7-b353-1988340021a1 tempest-ServerActionsTestJSON-2022006223 tempest-ServerActionsTestJSON-2022006223-project-member] Enqueued Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_members [ 1596.217932] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 with Priority: HIGHEST for action security_group_members [ 1596.217932] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-f35bb388-1251-4b12-b65e-3b2d1b58dda5 taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.218790] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.218790] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.218790] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.218790] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.218790] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.218790] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.218790] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.218790] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.219119] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f35bb388-1251-4b12-b65e-3b2d1b58dda5',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1596.721761] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.721957] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.721957] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.722190] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.722291] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.722493] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.722590] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.722653] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.722809] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.722888] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.722973] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 is going to be updated. [ 1596.753823] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1596.754078] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1596.754078] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1596.754264] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1596.754411] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1596.764218] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: IN_PROGRESS for 2s [ 1598.775869] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 in Status: SUCCESS [ 1598.776269] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f35bb388-1251-4b12-b65e-3b2d1b58dda5 deletion is rescheduled due to dependency. [ 1598.776269] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f35bb388-1251-4b12-b65e-3b2d1b58dda5" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1601.218927] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1601.219294] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1606.220135] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1606.220430] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1610.033799] env[69920]: INFO networking_nsxv3.common.synchronization [req-8aacdeab-677f-4fad-a206-02e327238516 req-39e93dd1-f8e3-40b6-9729-6819cf34ecc3 tempest-ServerActionsTestOtherA-296658517 tempest-ServerActionsTestOtherA-296658517-project-member] Enqueued Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGHEST for action security_group_members [ 1610.034348] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGHEST for action security_group_members [ 1610.034658] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-21459423-ae1a-4ef3-b1fd-549e38f9136d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.034773] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.034843] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.035049] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.035205] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1610.035434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1610.035434] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1610.035533] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1610.035629] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1610.035722] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1610.538197] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1611.040661] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1611.543554] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1611.543748] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1611.543748] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1611.543933] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1611.544039] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1611.544142] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d is going to be updated. [ 1611.571321] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1611.571570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1611.571570] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1611.571716] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1611.573409] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1611.583129] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d in Status: IN_PROGRESS for 2s [ 1613.594328] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d in Status: SUCCESS [ 1613.594688] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1615.035457] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1615.035834] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1620.036533] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1620.036885] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1625.037445] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1625.037754] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1625.270077] env[69920]: INFO networking_nsxv3.common.synchronization [req-d130057b-1419-4c86-acfc-b23f84eb6e25 req-d8855ca2-337b-4b7f-81c8-e6e20f1a4c90 tempest-ServerActionsTestOtherA-296658517 tempest-ServerActionsTestOtherA-296658517-project-member] Enqueued Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGHEST for action security_group_members [ 1625.271198] env[69920]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d with Priority: HIGHEST for action security_group_members [ 1625.271198] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock member-21459423-ae1a-4ef3-b1fd-549e38f9136d taken with stack trace [, , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.271198] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.271198] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.271455] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.271455] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.271586] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.271630] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.271768] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.271852] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.271944] env[69920]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21459423-ae1a-4ef3-b1fd-549e38f9136d',) {} {{(pid=69920) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1625.774083] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.774317] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.774317] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.774447] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.774515] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.774714] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.774815] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.774877] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.775038] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.775118] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.775205] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d is going to be updated. [ 1625.823276] env[69920]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69920) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1625.823276] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1625.823276] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1625.823623] env[69920]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1625.823856] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1625.833838] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d in Status: IN_PROGRESS for 2s [ 1627.844491] env[69920]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d in Status: SUCCESS [ 1627.844864] env[69920]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21459423-ae1a-4ef3-b1fd-549e38f9136d deletion is rescheduled due to dependency. [ 1627.844864] env[69920]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21459423-ae1a-4ef3-b1fd-549e38f9136d" {{(pid=69920) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1630.271914] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1630.272222] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1635.273101] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1635.273480] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1640.274396] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1640.274773] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1645.276194] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1645.276577] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1650.277606] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1650.277992] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1655.278743] env[69920]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1655.279193] env[69920]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0